CMS  Library 
C2-07-13 
7500  Security  Blvd. 
Baltimore,  MD  21244 


REPORT  TO  CONGRESS 

CONSOLIDATED  OMNIBUS  BUDGET  RECONCILIATION  ACT 
MEDICARE  PREVENTION  DEMONSTRATION 


Donna  E.  Shalala 
Secretary 
of  Health  and  Human  Services 
1993 


ACKNOWLEDGEMENTS 


This  report  is  based  on  a  study  conducted  by 
Abt  Associates,  Inc.,  for  the  Health  Care  Financing 
Administration  (Evaluation  of  COBRA  1985  Medicare  Prevention 
Demonstration,  Contract  No.  500-87-0030(2)). 


TABLE  OF  CONTENTS 


1.0    EXECUTIVESUMMARY   ! 

1.1  Overview  of  the  Project   1 

1.2  The  Prevention  Intervention   2 

1.3  Research  Design,  Sampling,  and  Measurement  Issues  3 

1.4  Preventive  and  Acute  Expenditures  and  Utilization  During  the 

First  Year  of  the  Demonstration   5 

1.5  Effects  of  the  Demonstration  on  Beneficiary  Health  and  Functional 

Status  9 

1.6  Effects  on  Beneficiary  Behavior   9 

1.7  Summary  and  Conclusions   10 

2.0    OVERVIEWOF  THE  PROJECT   12 

2.1  Legislative  Background    12 

2.2  Implementation  of  the  COBRA  Demonstration   13 

3.0    PREVENTIONINTERVENTION   17 

3. 1  Delivery  of  the  Intervention   17 

3.2  Health  Risk  Assessment  (HRA)   22 

3.3  Clinical  Screening    24 

3.4  Health  Education  and  Promotion    26 

4.0    RESEARCHDESIGN,  SAMPLING  AND  MEASUREMENTISSUES    28 

4.1  Data  Pooling   28 

4.2  Factors  Affecting  the  Internal  Validity  of  Demonstration 

Findings:  Enrollee  Sampling    30 

4.3  External  Validity:  The  Demonstration  as  a  Model  for  a 

Medicare  Benefit   39 

5.0    PREVENTIVEAND  ACUTE  SERVICE  EXPENDrTURESAND 
UTTLIZATIONDURINGTHE  FIRST  YEAROF  WAIVERED 

SER  VICES  PRO  VISION  UNDERTHE  DEMONSTRATION   49 

5.1  Overview   49 

5.2  Data  Sources   49 

5.3  Participant  Utilization  of  Demonstration  Services   52 


i 


TABLE  OF  CONTENTS  (continued) 


5.3.1  Characteristics  of  Experimental  Participants 

Receiving  Services   52 

5.3.2  Type  of  Intervention  Services  Used    56 

5.4  Net  Total  Medicare  Expenditures  During  the  First  Year   61 

5.5  Effects  of  the  Prevention  Intervention  on  Medicare 

Expenditure  and  Utilization   63 

6.0  EFFECTS  OF  THE  DEMONSTRATION  ON  BENEFICIARY  HEALTH 

AND  FUNCTIONAL  STATUS   81 

6.1  Overview    81 

6.2  Data  Issues   82 

6.2.1  Data  Sources  and  Limitations   82 

6.2.2  Definition/Construction  of  Dependent  Variables   82 

6.2.3  Analytic  Approach    85 

6.3  Sample  Description   86 

6.4  Bivariate  Analyses  of  Outcomes   88 

6.5  Multivariate  Analyses  of  Outcomes    92 

7.0  EFFECTS  OF  THE  DEMONSTRATION  ON  BENEFICIARY 

HEALTH  BEHAVIORS   95 

7.1  Overview    95 

7.2  Data  Issues   95 

7.2.1  Data  Sources  and  Limitations   95 

7.2.2  Definition/Construction  of  Dependent  Variables   96 

7.2.3  Analytic  Approach    98 

7.3  Sample  Description   99 

7.4  Bivariate  Analyses  of  Outcomes   99 

7.5  Multivariate  Analyses  of  Outcomes   101 

8.0  SUMMARY  AND  CONCLUSIONS    106 


ii 


APPENDIX  A:  CHARACTERISTICS  OF  ENROLLEES  BY 
SITE 

APPENDIX  B:         CHARACTERISTICS  OF  ENROLLEES  BY 

RECEIPT  AND  NON-RECEIPT  OF 
INTERVENTION  SERVICES  BY  SITE 


.  •  • 

111 


1.0  EXECUTIVE  SUMMARY 

This  second  interim  report  summarizes  the  first  2  years  of  the  demonstration  during 
which  five  projects  implemented  the  Medicare  Prevention  Demonstration,  a  4-year 
demonstration  mandated  by  section  9314(b)  of  the  Consolidated  Omnibus  Budget 
Reconciliation  Act  (COBRA)  of  1985  to  test  the  effectiveness  of  offering  disease 
prevention  and  health  promotion  services  to  Medicare  beneficiaries.  An  earlier  interim 
report,  submitted  in  1989,  described  implementation  of  the  demonstration  projects.  In 
1990,  Congress  extended  the  demonstration  for  2  years.  Therefore,  a  final  report  on  the 
demonstration  is  due  to  Congress  on  April  1,  1995. 

1.1  Overview  of  the  Project 

The  COBRA  legislation  provided  an  initial  $5.9  million  to  support  project 
administration;  the  collection  of  health  risk  appraisal  information;  the  delivery  of  disease 
prevention  services  (immunizations,  clinical  screens)  and  health  promotion  and  education 
services  (such  as  diet  and  nutrition  workshops,  alcohol  and  drug  abuse  counseling)  to 
Part  B-eligible  Medicare  beneficiaries;  and  the  completion  of  project  and  cross-cutting 
evaluations  of  the  demonstration.  In  1991,  Congress  increased  funding  to  $10.5  million  to 
support  the  2-year  extension  of  the  demonstration.  The  cross-cutting  evaluation  was 
expected  to  answer  two  major  questions:  Did  eligible  beneficiaries  use  preventive  services 
offered  through  the  demonstration;  and  did  use  of  preventive  services  have  positive  effects 
on  cost,  utilization,  overall  health  status,  and  health  behaviors? 

The  Health  Care  Financing  Administration  (HCFA)  selected  five  demonstration 
projects:  two  organized  around  managed  care  plans  (the  University  of  Washington  and  San 
Diego  State  University)  and  three  organized  around  fee-for-service  health  care  delivery 
(Johns  Hopkins  University,  the  University  of  Pittsburgh,  and  the  University  of  California 
at  Los  Angeles  (UCLA)).  HCFA  also  contracted  with  Abt  Associates,  Inc.,  and  its 
subcontractor,  Brown  University,  to  conduct  the  cross-cutting  evaluation  and  provide 
technical  assistance  to  the  projects. 

The  start  of  the  demonstration  was  delayed,  from  January  to  May  1989,  to 
accommodate  negotiations  between  HCFA  and  the  projects  over  changes  in  service 


packages,  clearance  of  waiver  cost  estimates,  and  the  conclusion  of  provider  agreements 
by  some  projects. 

1.2    The  Prevention  Intervention 

The  COBRA  demonstration  projects  offered  experimental  enrollees  disease 
prevention  and  health  promotion  services  for  a  2-year  period,  from  May  1989  through 
April  1991.  Health  risk  appraisals  {HR As)  were  conducted  to  collect  baseline  and  follow- 
up  data  for  both  experimental  and  controls.  The  intervention  differed  among  the  projects, 
reflecting  a  range  of  decisions  on  design  and  implementation.  These  differences  and  their 
relationship  to  project  outcomes  will  be  more  fully  evaluated  in  the  final  Report  to 
Congress. 

Methods  of  delivering  preventive  services  differed  among  the  projects.  For  some 
projects,  e.g.,  Johns  Hopkins  and  Pittsburgh,  physicians  delivered  the  services  to  some  or 
all  subjects;  in  others,  allied  health  personnel  substituted  for  physicians.  Participants  had 
to  schedule  their  own  visits  in  the  Johns  Hopkins  project;  visits  were  scheduled  for  the 
participants  in  the  other  projects.  In  UCLA,  San  Diego,  and  the  hospital  portion  of  the 
Pittsburgh  demonstration,  providers  were  at  risk  under  capitated  payments  for  the  complete 
package  of  services;  in  others,  fee-for-service  providers  were  paid  for  partially  unbundled 
services. 

Projects  differed  in  the  sequence  and  mechanics  of  service  delivery.  For  example, 
Johns  Hopkins  and  Pittsburgh  experimental  enrollees  received  vouchers  to  be  used  for  their 
preventive  visits.  All  scheduling  and  service  provision  was  managed  by  participating  clinics 
in  the  Washington  project  UCLA  used  project  "Health  Promotion  and  Screening  Clinics" 
to  deliver  all  preventive  services  at  a  single  site. 

The  projects  used  data  from  the  HRAs,  conducted  before  delivery  of  preventive 
services,  in  various  ways.  UCLA  provided  dental  and  psychosocial  screenings.  Johns 
Hopkins  summarized  Health  Behavior  Profiles  for  each  experimental  enrollee  and  mailed 
a  copy  to  the  appropriate  participating  physician. 

The  order  in  which  projects  delivered  preventive  services  and  the  content  of  those 
services  varied.  Most  projects  provided  a  clinical  screening  visit  before  any  counseling 


visits.  However,  Washington  provided  a  counseling  visit  before  the  clinical  visit.  The 
content  of  clinical  screening  and  medical  interventions  varied.  All  projects  except  UCLA 
provided  influenza  immunizations.  Only  UCLA  provided  dental  screenings.  The  projects 
concentrated  their  efforts  in  health  counseling  on  six  or  seven  priority  areas.  All  of  the 
projects  promoted  smoking  cessation.  Other  common  areas  covered  nutrition  and  diet, 
alcohol  use,  mental  health  and  sleep  disturbance,  exercise,  and  injury  prevention. 

13    Research  Design,  Sampling,  and  Measurement  Issues 

The  interpretation  of  preliminary  data  from  the  demonstration  requires  some 
understanding  of  the  original  research  design,  the  sampling  strategies  adopted  by  the 
projects,  and  the  shortcomings  of  demonstration  data. 

Data  Pooling.  Although  the  cross-cutting  evaluation  analyses  pooled  data  across  all 
five  projects,  the  projects  differed  in  the  contents  of  their  initial  demonstration  designs  and 
demonstration  service  packages  and  in  the  risk  profiles  of  demonstration  enrollees. 
Therefore,  to  try  to  standardize  measures  and  data  collection  methods,  the  evaluator 
worked  with  the  individual  projects  to  develop  a  minimum  data  set  (MDS)  of  demographic, 
socioeconomic,  and  health-related  measures  that  would  be  common  to  all  projects.  The 
MDS  provides  only  a  partial  solution  to  the  problem  of  diversity,  however.  For  this  reason, 
each  project  will  complete  its  own  evaluation,  and  the  cross-cutting  evaluator  will  utilize 
statistical  techniques  to  adjust  for  measurable  and  immeasurable  differences  among  the 
projects. 

Enrollee  Sampling.  COBRA  demonstration  enrollees  were  randomly  assigned  to 
experimental  and  control  groups  to  minimize  differences  in  the  characteristics  of  the  two 
groups  that  might  complicate  the  identification  of  the  demonstration  effects.  Each  project 
set  certain  limits  on  its  target  population  (for  example,  excluding  institutionalized  and 
homebound  elderly).  Generally,  random  assignment  achieved  the  goal  of  minimizing  inter- 
group  differences  in  each  project. 

Spill-Over  Effects.  In  recruiting  from  the  target  populations,  each  project  also  dealt 
differently  with  the  potential  problem  of  spill-over  effects  (control  group  members  receive 
some  of  the  informational  content  of  the  intervention  that  should  be  provided  only  to 
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experimental  enrollees).  On  the  one  hand,  Johns  Hopkins  carefully  limited  publicity  about 
the  demonstration.  Pittsburgh,  on  the  other  hand,  faced  with  a  difficult  recruitment  task 
in  rural  Western  Pennsylvania,  widely  publicized  the  demonstration.  There  is  no  evidence 
at  this  time  that  spill-over  effects  occurred. 

Attrition  Bias.  Attrition  threatens  the  evaluation  if  it  changes  the  characteristics  of 
the  samples  of  experimentals  and  controls.  Almost  70  percent  of  enrollees  completed 
follow-up  interviews,  from  1  to  2  years  after  intake  into  the  demonstration.  However,  there 
was  a  slight  tendency  for  higher  rates  of  attrition  (not  completing  the  follow-up  interview) 
among  experimentals  than  among  controls.  Those  who  dropped  out  tended  to  be  male, 
less  educated,  married  and  living  with  a  spouse  or  other  individuals,  still  in  the  work  force, 
older,  and  in  the  lowest  income  group.  Some  attrition  results  apparently  from  incomplete 
follow-up  efforts  in  some  projects,  rather  than  non-participation.  Most  changes  in  sample 
characteristics  were  relatively  small  and  had  little  effect  on  the  distributions  of  experimental 
and  control  group  characteristics  at  follow-up. 

The  Demonstration  Intervention.  The  appropriate  tests  of  intervention  effects  in  this 
demonstration  are  based  on  the  "intent-to-treat"  model,  and  tests  of  this  type  were  applied 
to  preliminary  demonstration  data.  This  model  considers  all  experimentals  as  exposed  to 
the  intervention,  regardless  of  whether  or  not  they  actually  used  preventive  services  and 
avoids  the  problem  of  selection  bias  introduced  by  the  fact  that  experimental  enrollees  can 
choose  to  use  or  not  use  these  services.  However,  for  the  final  report  on  the 
demonstration,  the  evaluator  will  also  use  statistical  controls  to  adjust  for  selection 
problems,  in  order  to  study  and  report  on  the  effects  of  preventive  service  use. 

The  Demonstration  as  a  Model  for  a  Medicare  Benefit.  The  COBRA  demonstration 
has  limitations  as  a  model  for  a  Medicare  benefit  that  should  be  recognized.  It  only  tests 
the  implications  of  providing  a  package  of  preventive  services;  the  effectiveness  of 
individual  components,  such  as  influenza  vaccinations,  cannot  readily  be  explored.  In 
addition,  the  demonstration  enrollees  differ  in  many  ways  among  the  five  projects,  as  they 
differ  from  the  "average"  Medicare  beneficiary.  Minority  participation  is  extremely  low  in 
all  projects  except  Johns  Hopkins  and  UCLA.  Education  and  income  are  lower  in  Johns 
Hopkins  and  Pittsburgh  than  in  the  three  West  Coast  projects.  Measures  of  baseline  health 
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status  and  risk  factors  vary  widely  among  the  projects.  Compared  to  the  average  Medicare 
beneficiary,  however,  the  average  COBRA  demonstration  enrollee  is  less  often  hospitalized 
(with  1989  hospitalization  rates  ranging  from  7,000  to  26,000  per  100,000,  compared  to 
33,000  per  100,000  for  all  Medicare  beneficiaries)  and  subject  to  lower  annual  death  rates, 
averaging  2,556  deaths  per  100,000  in  1989,  compared  to  4,700  per  100,000.  Therefore, 
findings  from  the  demonstration  may  not  apply  to  less  healthy  Medicare  enrollees,  but  they 
do  describe  the  kinds  of  beneficiaries  most  likely  to  use  a  Medicare  preventive  services 
benefit. 

In  addition,  some  participants  in  the  demonstration  (and  potential  participants  in  a 
Medicare  benefit)  may  previously  have  paid  for  their  own  preventive  services.  If  so,  they 
would  represent  individuals  for  whom  a  prevention  benefit  would  shift  costs  from  the 
beneficiaries  or  from  other  payers  onto  Medicare,  rather  than  individuals  newly  attracted 
by  the  benefit  to  utilize  preventive  services.  These  concerns  highlight  the  need  for  careful 
analyses,  in  the  final  report  of  the  demonstration,  of  the  behavior  of  sub-groups  of 
enrollees  with  and  without  evidence  of  preventive  services  utilization  before  the 
demonstration. 

1.4    Preventive  and  Acute  Expenditures  and  Utilization  During  the  First  Year  of  the 
Demonstration 

Preliminary  evidence  from  the  demonstration  on  the  contribution  of  preventive 
services  to  reductions  in  Medicare-reimbursed  health  care  addresses  two  central  research 
questions:  (1)  Did  those  elderly  beneficiaries  who  were  offered  preventive  services  through 
the  demonstration  use  them;  and  (2)  were  the  availability  and  use  of  preventive  services 
through  the  demonstration  associated  with  any  effects  on  hospitalization  rates,  utilization 
of  non-hospital  services,  and  Medicare  expenditures? 

Enrollee-level  data  for  the  analysis  were  taken  from  several  sources,  including 
information  on  the  dollar  value  and  numbers  of  demonstration  service  encounters, 
demographic  and  socioeconomic  data  from  the  MDS,  and  non-demonstration  acute  service 
utilization  data  for  the  first  year  of  the  demonstration.  For  the  two  managed  care  projects, 
non-demonstration  utilization  data  came  from  the  internal  files  of  participating  health 
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maintenance  organizations  (HMOs).  Only  detailed  hospitalization  data  were  available  for 
the  managed  care  projects.  For  the  three  fee-for-service  projects,  Medicare  claims  and 
eligibility  files  provided  total  numbers  of  hospital  and  nursing  home  admissions,  home 
health  visits,  and  Medicare  reimbursements  for  non-demonstration  services. 

Nearly  80  percent  of  experimental  enrollees  used  some  demonstration  preventive 
services  during  the  first  year  of  the  demonstration,  with  some  variation  among  projects; 
only  59  percent  received  services  in  the  Johns  Hopkins  project1,  while  96  percent  did  so 
in  San  Diego.  Johns  Hopkins  participants  were  least  likely  to  use  the  maximum  number 
of  services  available  (participants  averaged  1.4  visits,  out  of  a  total  4  visits  available).  In 
Washington,  participants  averaged  2.8  out  of  a  maximum  3  visits.  Women  were  less  likely 
than  men  to  use  preventive  services.  College-educated  enrollees  were  more  likely  than  the 
less-educated  enrollees  to  use  intervention  services. 

During  the  first  year  of  the  demonstration,  HCFA  spent  approximately  $1.2  million 
dollars  to  provide  health  risk  appraisals  and  preventive  services.  Expenditure  per 
experimental  beneficiary  averaged  $116,  varying  among  projects  in  response  to  variations 
in  total  experimental  sample  sizes,  rates  of  service  utilization,  and  reimbursement  rates  for 
demonstration  preventive  services. 

No  immediate  effects  of  the  demonstration  on  beneficiary  use  of  non-demonstration 
services  were  expected.  If  anything,  a  slight  increase  in  utilization  might  have  been 
predicted,  in  response  to  discoveries  through  clinical  screens  of  previously  undiagnosed 
conditions.  In  addition,  it  was  expected  that  any  effects  would  be  smaller  among  managed 
care  enrollees,  who  should  have  been  exposed  to  more  primary  prevention  before  the 
demonstration  than  fee-for-service  enrollees,  and  among  enrollees  with  pre-demonstratioc 
hospital  episodes,  who  would  presumably  be  less  likely  than  those  not  previously 
hospitalized  to  have  undetected  medical  conditions. 

Approximately  10  to  20  percent  of  demonstration  enrollees  used  any  inpatient 
hospital  services  during  the  first  year  of  the  demonstration.  There  were  sizable  differences 


Removing  individuals  known  to  have  died  or  moved,  the  Johns  Hopkins  percentage  increases  to  66  percent 
(based  on  data  provided  in  a  personal  communication  from  the  Johns  Hopkins  Principal  Investigator). 
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in  hospital  utilization  between  managed  care  and  fee-for-service  projects  for  both 
experimental  enrollees  and  controls.  For  example,  in  the  managed  care  projects, 
12.1  percent  of  controls  were  hospitalized  (compared  to  18.4  percent  in  the  fee-for-service 
projects).  Of  those  who  were  hospitalized,  managed-care  controls  experienced 
1.19  admissions,  with  average  stays  of  6.23  days,  compared  to  1.53  admissions  averaging 
12.85  days  among  fee-for-service  controls. 

In  general,  experimental  enrollees  experienced  neither  higher  nor  lower  rates  of 
hospitalization  than  control  group  members  in  the  three  fee-for-service  projects.  In  the 
managed  care  projects,  experimental  enrollees  and  controls  were  alike  in  frequency  of 
hospitalization  and  in  length  of  inpatient  stay;  however,  those  experimental  enrollees  who 
were  hospitalized  experienced  0.12  more  admissions  on  average  than  controls. 

This  lack  of  an  "effect"  of  the  demonstration  on  hospital  utilization  conceals 
significant  differences  between  those  in  the  experimental  group  who  used  preventive 
services  and  those  who  did  not.  Preventive  service  users  differed  little  from  controls  in 
their  use  of  hospital  and  other  acute  care  services.  However,  experimental  enrollees  who 
did  not  use  preventive  services  were  much  more  likely  to  be  hospitalized,  and  had  more 
and  longer  hospital  stays,  than  controls.  Even  after  adjusting  for  other  factors  that  might 
explain  hospital  utilization,  experimental  enrollees  who  used  no  preventive  services  during 
the  first  year  of  the  demonstration  were  hospitalized  at  a  rate  4  percentage  points  higher 
than  controls,  for  0.16  more  admissions,  and  for  2.13  more  days  per  stay.  This  finding  was 
confirmed  for  the  individual  projects  as  well,  with  the  exception  of  San  Diego  and  Johns 
Hopkins  for  which  estimated  differences  were  statistically  insignificant  Pre-demonstration 
hospital  use  proved  to  be  associated  with  hospital  use  during  the  demonstration. 
Hospitalizations  among  experimental  enrollees  who  used  no  preventive  services  offered  by 
the  demonstration  exceeded  the  rate  among  controls  by  10.99  percentage  points,  compared 
to  3.21  percentage  points  for  non-using  experimental  enrollees  who  had  not  been  previously 
hospitalized.  Clearly,  non-users  were  very  ill  individuals,  compared  both  to  the  average 
control  group  member  and  to  experimentals  who  actively  participated. 

In  the  three  fee-for-service  projects,  few  enrollees  used  Medicare-reimbursed  home 
health  services  (about  7  percent),  and  fewer  still  (under  1  percent)  used  nursing  facility 
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services.  There  were  no  statistically  significant  differences  between  experimental  enrollees 
and  controls  in  utilization  or  expenditures  for  these  services.  As  proved  to  be  the  case  for 
hospitalizations,  those  enrollees  who  required  home  health  or  nursing  facility  services 
before  the  demonstration  were  more  likely  to  require  these  services  during  the 
demonstration.  Also,  experimental  enrollees  who  used  demonstration  preventive  services 
were  less  likely  to  be  admitted  to  a  nursing  facility  (an  average  of  .008  admissions, 
compared  to  .021  admissions  for  experimental  enrollees  who  used  no  preventive  services) 
and  less  likely  to  require  home  health  visits  (averaging  1.17  visits,  compared  to  2.42  among 
non-users). 

Preliminary  analyses  suggest  that  the  availability  of  preventive  services  during  the  first 
year  of  the  demonstration  did  not  affect  utilization  of  Medicare-reimbursed  acute  care 
services.  This  finding  was  confirmed  in  most  of  the  projects.  Neither  the  organizational 
model  of  the  projects  (managed  care  versus  fee-for-service)  nor  pre-demonstration 
utilization  patterns  of  the  enrollees  were  associated  with  statistically  significant 
demonstration  effects.  However,  these  analyses  also  demonstrated  a  clear  selection  effect 
among  experimentals  to  utilize  or  not  utilize  preventive  services.  Preventive  services  users 
appear  to  have  been  a  self-selected  majority  of  experimental  enrollees  who  were  at  less  risk 
of  acute  health  problems  than  non-users.  The  final  report,  which  will  capture  long  term 
changes  in  health  risks  and  associated  acute  care  utilization  patterns,  will  provide  a  fairer 
test  of  prevention  effects,  because  the  potential  savings  in  hospital  and  other  utilization 
among  preventive  services  users  should  be  realized  beyond  the  first  year. 
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1.5    Effects  of  the  Demonstration  on  Beneficiary  Health  and  Functional  Status 

Statistical  analyses  were  conducted  to  determine  the  effects  of  the  demonstration  on 
self-reported  health  and  functional  status.  It  was  expected  that  no  short-run  effects  would 
be  observed  but  that  long-run  effects  (to  be  captured  in  analyses  for  the  final  report)  would 
be  positive  (experimental  enrollees  would  report  improved  health  and  reduced  declines  in 
functional  status). 

Data  to  measure  health  status  and  function  were  collected  at  baseline  and  follow-up 
interviews  as  part  of  the  MDS.  Outcome  measures  were  defined  as  changes  between 
baseline  and  follow-up  surveys;  therefore,  projects  (and  enrollees)  with  missing 
information  were  excluded  from  the  analyses.  Pittsburgh,  whose  experimental  enrollees 
were  significantly  underrepresented  because  of  lags  in  completing  follow-up  interviews,  was 
excluded  from  these  analyses. 

Changes  in  health  status  were  analyzed  through  three  measures:  self-reported  health 
status,  reported  numbers  of  bed  days,  and  numbers  of  falls.  Changes  in  functional  status 
were  analyzed  for  four  measures:  dependence  in  bathing,  dressing,  traveling  (getting  to 
places  by  car  or  public  transportation),  and  stamina  (available  for  Johns  Hopkins,  UCLA, 
Washington).  Analysis  showed  clear  variations  related  to  differences  in  the  ways  individual 
projects  measured  outcomes. 

Bivariate  analyses  revealed  significantdiff  erences  between  experimental  enrollees  and 
controls  in  the  following  measures  of  health  status  and  function:  self-reported  health 
status,  number  of  falls,  and  dependence  in  dressing.  However,  other  outcomes 
(e.g.,  physical  and  social  activity,  mobility)  did  not  display  any  net  differential  between 
experimental  enrollees  and  controls.  Therefore,  it  would  be  premature  to  argue  that  the 
hypothesized  (long-run)  positive  effects  of  the  demonstration  on  health  status  and  function 
have  been  realized. 
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1.6  Effects  on  Beneficiary  Behavior 

Analyses  were  conducted  to  determine  the  effects  on  self-reported  health  behaviors 
of  making  preventive  services  available.  As  with  health  status  and  function,  no  short-run 
effects  were  expected,  but  relative  improvements  in  health  behaviors  were  predicted  for 
experimentals  over  the  long  run  (to  be  analyzed  for  the  final  report). 

Behavioral  measures  were  calculated  as  change  scores  between  baseline  and  follow- 
up  surveys  for  several  variables,  including  indicators  of  smoking  behavior,  alcohol 
consumption,  frequency  of  exercise/physical  activity,  use  of  seatbelts,  having  a  mammogram 
within  the  past  1-2  years,  and  seeking  information  about  health.  As  with  measures  of 
health  status  and  function,  special  adjustments  were  required  to  adjust  for  differences  in 
the  way  individual  components  were  measured  in  the  projects.  Strong  project  effects 
related  to  measurement  differences  among  projects  were  detected  in  the  statistical  analyses. 

Experimental  and  control  groups  were  generally  comparable  in  health  behaviors  at 
baseline,  but  bivariate  analyses  showed  some  significant  improvements  in  two  measures. 
Experimental  enrollees  were  more  likely  to  report  exercising  at  follow-up  than  controls. 
Experimental  enrollees  were  also  more  likely  than  controls  to  have  reduced  (or  not 
increased)  alcohol  consumption. 

When  estimates  of  demonstration  effects  were  adjusted  for  other  influences,  however, 
there  is  strong  evidence  for  widespread  improvement  directly  attributable  to  exposure  to 
the  preventive  intervention.  At  followup,  members  of  the  experimental  group  were 
approximately  15  percent  less  likely  than  controls  to  report  never  exercising  and  20  percent 
more  likely  to  report  exercising  3  or  more  times  per  week.  Regular  seatbelt  use  was 
15  percent  more  frequent  among  experimental  enrollees  than  among  controls. 
Mammograms  were  23  percent  more  frequent  among  experimental  enrollees.  A  decline 
in  alcohol  consumption  was  more  likely  among  experimentals.  No  effects  on  smoking 
behavior  or  health  information-seeking  behavior  were  detected. 

1.7  Summary  and  Conclusions 

The  COBRA  Medicare  Prevention  Demonstration  projects  substantially  met  their 
recruitment  targets,  and  an  average  of  80  percent  of  enrollees  who  were  assigned  to 
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experimental  group  status  actually  used  some  demonstration  preventive  services  during  the 
first  year. 

Experimental  status  was  not  associated  with  significant  reductions  in  Medicare- 
reimbursed  acute  services  utilization.  However,  there  was  clear  evidence  that  those 
experimental  enrollees  who  used  preventive  services  were  different  from  those  who  did  not, 
both  in  predisposing  characteristics  (demographic,  socioeconomic)  and  in  actual  use  of 
acute  services.  Within  the  randomly  assigned  study  populations,  self-selection  into  user  and 
non-user  experimental  enrollees  occurred  during  the  initial  years  of  the  demonstration. 

Experimental  status  was  associated  with  some  unexpected  short-term  improvements 
in  certain  measures  of  health  status  and  health  behavior  relative  to  controls.  Although  not 
all  measures  confirmed  these  positive  findings,  the  evidence  for  true  demonstration  effects 
is  compelling. 

During  the  final  2  years  of  the  demonstration,  the  projects  will  collect  additional 
follow-up  data  and  complete  their  own  evaluations.  The  crosscutting  evaluator  will 
complete  a  final  report  on  the  cost-effectiveness  of  a  preventive  services  benefit  package 
for  submission  to  Congress  by  April  1,  1995. 
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2.0  OVERVIEW  OF  THE  PROJECT 

This  second  interim  report  summarizes  the  first  2  years  of  the  demonstration  during 
which  five  projects  were  implemented  under  the  COBRA  Medicare  Prevention 
Demonstration.  Congress  intended  that  the  demonstration  should  test  the  feasibility  and 
cost-effectiveness  of  providing  disease  prevention  and  health  promotion  services  to  elderly 
Medicare  beneficiaries.  In  the  Omnibus  Budget  Reconciliation  Act  of  1990,  Congress 
funded  an  additional  2  years  of  the  demonstration.  Although  HCFA  planned  to  report 
conclusions  from  the  demonstration  this  year,  Congress'  extension  facilitates  the  collection 
of  additional  longitudinal  data  to  provide  a  more  rigorous  test  of  the  cost-effectiveness 
hypothesis.  Therefore,  this  interim  report  presents  findings  based  on  data  from  the  first 
year  of  waivered  services  delivery.  Findings  on  cost-effectiveness  subsequently  will 
incorporate  longitudinal  evidence  accumulated  from  the  beginning  of  the  demonstration 
in  a  final  report  due  to  Congress  on  April  1,  1995. 

2.1  Legislative  Background 

In  COBRA  1985,  Congress  mandated  a  4-year  demonstration  to  test  the  effectiveness 
of  providing  disease  prevention  and  health  promotion  services  to  Medicare  beneficiaries. 

The  COBRA  legislation  set  specific  requirements  for  the  demonstration.  Schools  of 
public  health  or  departments  of  preventive  medicine  would  administer  the  demonstration 
in  at  least  five  projects,  including  one  rural  area.  Each  project  would  enroll  and  provide 
a  package  of  preventive  services  to  Medicare  Part  B-eligible  beneficiaries,  including  health 
screens  (with  cancer  screening  in  at  least  one  site),  HRAs,  immunizations,  and  counseling 
and  instruction  in  diet  and  nutrition,  stress  reduction,  exercise,  sleep  regulation,  injury 
prevention,  alcohol  and  drug  abuse  issues,  mental  health  disorders  and  their  care,  self -care 
including  use  of  medications,  and  reduction  or  cessation  of  smoking.  The  projects  would 
test  the  effects  of  alternative  payment  methods  and  combinations  of  providers  for 
delivering  preventive  services.  Congress  initially  limited  Federal  expenditures  for  the 
administration  of  the  demonstration  and  a  cross-cutting  evaluation  to  $5.9  million.  In  1991, 
to  support  the  2-year  extension  of  the  demonstration,  Congress  increased  the  funding  limit 
to  $10.5  million. 
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To  analyze  the  cost-effectiveness  of  a  Medicare  prevention  benefit,  the  evaluation  of  the 
demonstration  will  address  two  questions: 

Did  eligible  beneficiaries  utilize  preventive  services  offered  through  the 
demonstration? 

Was  there  evidence  that  those  who  were  offered  and  used  preventive  services 
through  the  demonstration  experienced  greater  improvements  in  general  health 
status  and  function,  reductions  in  morbidity,  and  more  positive  attitudes  on 
health  risks  and  health  behaviors  than  similar  beneficiaries  without  access  to 
demonstration  services? 


2.2  Implementation  of  the  COBRA  Demonstration 

From  11  applicants  that  responded  to  a  Federal  Register  announcement  in  May  1987, 
HCFA  selected  projects  in  5  geographic  areas  to  implement  the  demonstration.  Awards 
were  made  in  April  1988.  Two  projects  proposed  to  recruit  participants  from  managed 
care  (HMO)  plans  and  three  proposed  to  recruit  from  beneficiaries  served  by  fee-for- 
service  providers: 

Managed  Care  Models 

The  University  of  Washington  (Department  of  Health  Sciences),  collaborating 
with  the  Center  for  Health  Studies  and  the  Center  for  Health  Promotion  of 
Group  Health  Cooperative 

San  Diego  State  University  (Graduate  School  of  Public  Health),  collaborating 
with  the  Secure  Horizons  HMO  and  the  Sharp  Rees-Stealy  Medical  Group 

Fee-for-Service  Models 

The  University  of  California  at  Los  Angeles  (School  of  Public  Health) 

The  Johns  Hopkins  University  (Health  Services  Research  and  Development 
Center),  collaborating  with  the  Center  for  Medical  Education  and  Survey 
Research  Associates 

The  University  of  Pittsburgh  (Graduate  School  of  Public  Health) 

HCFA  chose  these  projects  to  capture  the  variations  in  demonstration  design  that 
Congress  required.   Exhibit  2-1  compares  major  design  characteristics  among  the  five 
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projects.  The  University  of  Pittsburgh's  target  population  lives  in  five  rural  counties  in 
Western  Pennsylvania.  2  Each  of  the  other  four  projects  draws  participants  from  a 
metropolitan  area  (San  Diego,  Los  Angeles,  Baltimore,  and  Seattle-Tacoma).  Three 
projects  (San  Diego,  UCLA,  and  Washington)  recruited  participants  through  providers, 
whereas  Johns  Hopkins  and  Pittsburgh  recruited  directly  from  their  target  populations. 
The  five  projects  delivered  the  preventive  services  package  using  various  combinations  of 
staff  (physicians,  allied  health  personnel)  and  settings  (physicians'  offices,  hospital  and 
HMO  outpatient  clinics).  Two  projects  (Johns  Hopkins  and  the  University  of  Washington) 
implemented  modest  cancer  screening  components. 

In  1987,  HCFA  also  contracted  with  Abt  Associates,  Inc.,  to  conduct  a  cross-cutting 
evaluation  of  the  demonstration  and  to  provide  technical  assistance  to  the  individual 
projects. 

Although  originally  scheduled  to  begin  in  October  1988,  the  demonstration  projects 
actually  received  permission  to  start  enrolling  participants  in  May  1989.  Several  factors 
contributed  to  the  delay. 

First,  although  HCFA  had  provisionally  approved  protocols  from  most  of  the 
demonstration  projects  in  January,  negotiations  continued  over  the  exact  content  of  each 
project's  prevention  package  and  the  appropriate  Medicare  payment  rates  for  these 
services.  Although  the  projects  had  defined  their  service  packages  in  their  proposals, 
within  the  broad  guidelines  of  the  COBRA  1985  legislation,  HCFA  proposed  certain 
specific  changes.  For  example,  HCFA  requested  that  Johns  Hopkins  remove 
mammography  from  its  list  of  waivered  prevention  services,  in  anticipation  of  regular 
Medicare  coverage  under  the  Medicare  Catastrophic  Coverage  Act  Second,  HCFA  had 
to  coordinate  waiver  cost  estimates  from  each  of  the  projects  and  review  and  approve  the 
estimates. 

Finally,  many  of  the  projects  delayed  concluding  provider  agreements  until  they  had 
received  approval  of  the  estimated  waiver  costs. 


2Clanon,  Clearfield,  Elk,  Forest,  Jefferson. 
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With  permission  to  proceed,  the  COBRA  demonstration  projects  moved  rapidly  to 
enroll  beneficiaries  and  to  begin  offering  preventive  services.  To  accommodate  the  delay 
in  implementation,  HCFA  reduced  the  length  of  the  evaluation  period. 

A  preliminary  Report  to  Congress,  submitted  in  July  1989,  described  the  planning  and 
implementation  of  the  demonstration.  This  current  report  presents  preliminary  findings 
based  on  data  collected  for  the  cross-cutting  evaluation.  Chapter  3.0  describes  the 
prevention  interventions  implemented  by  the  five  projects.  Chapter  4.0  reviews  the 
evaluation  design  and  discusses  approaches  taken  to  overcome  certain  methodological 
obstacles.  In  addition,  it  describes  the  characteristics  of  the  Medicare  population  enrolled 
in  the  demonstration.  Chapters  5.0,  6.0,  and  7.0  present  preliminary  findings  on  the 
"effects"  of  offering  preventive  services  to  Medicare  beneficiaries  on  Medicare  expenditures 
and  utilization,  health  status  and  quality  of  life,  and  health-related  behavior.  Chapter  8.0 
summarizes  these  findings. 
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EXHIBIT  2-1 


COBRA  MEDICARE  PREVENTION  DEMONSTRATION 
CHARACTERISTICS  OF  THE  PROJECTS 


CHARACTERISTIC 

Location 

Beneficiary 

Recruitment 

Model 


practitioner 
Model 


Cancer  Screening 
Coroponent 


JOHNS  HOPKINS        PITTSBURGH    UCLA        SAN  DIEGO  WASHINGTON 


Urban 

Population-based 


Private  physicians; 
solo,  group  practice, 
and  hospital  outpatient 
department 

Yes 


Rural 

Population- 
based 


Hospital  OPD 
clinics,  private 
physicians 

No 


Urban 

Provider- 
based 
(Fee-for- 
service) 

Allied 
health 
personnel 

No 


Urban 

Provider- 
based  (HMO) 


HMO/Group 
Practice  • 
physician 

No 


Urban 

Provider-based 
(HMO) 


HMO  Clinics 


Yea 


3.0  PREVENTION  INTERVENTION 

The  COBRA  legislation  stipulates  that  the  package  of  demonstration  services  include 
health  risk  appraisals  (HRAs),  clinical  health  screening,  immunizations,  and  counseling  and 
instruction  in  healthy  behavior  ("health  promotion").  With  the  exception  of  cancer 
screening  (to  be  included  in  the  package  of  at  least  one  project),  the  details  of  the  service 
package  were  left  to  the  professional  judgment  of  project  staff. 

Components  of  the  package  have  three  major  uses,  two  of  which  involve  data 
generation.  First,  health  screenings  provide  information  that  researchers  can  use  to 
evaluate  the  health  status  of  demonstration  participants.  Second,  HRAs,  screenings  and 
counseling  and  instruction  provide  information  for  participants,  who  are  hypothesized  to 
respond  by  taking  steps  to  change  unhealthful  behavior,  and  for  health  care  providers,  who 
use  the  data  to  describe  further  clinical  interventions,  as  needed.  Third,  immunizations  are 
direct  clinical  interventions  against  infectious  diseases. 

The  COBRA  demonstration  "intervention"  included  information  and  clinical  components 
provided  only  to  experimental  group  members.  COBRA  projects  have  used  HRAs  and 
some  health  screening  services  to  collect  health  status  data  from  control  participants.  Thus, 
waivered  services  payments  sometimes  cover  more  than  the  services  included  in  the 
intervention  package.  In  fact,  some  projects  negotiated  separate  rates  for  health  risk 
appraisals  administered  to  control  participants. 

This  section  compares  the  contents  of  intervention  packages  among  the  COBRA 
projects  (see  Exhibit  3-1).  Given  the  unsettled  state  of  research  into  effective  prevention 
strategies  for  the  elderly,  it  is  not  surprising  that  there  is  diversity  among  the  projects. 
However,  the  following  discussion  shows  again  the  importance  of  project-specific  analysis 
of  linkages  between  prevention  services  and  outcomes. 

3.1  Delivery  of  the  Intervention 

Although  the  COBRA  legislation  defines  the  major  components  of  the  intervention 
package,  the  manner  in  which  the  COBRA  projects  delivered  preventive  services  varied. 


17 


EAntoii  3-1 

COBRA  MEDICARE  PREVENTION  DEMONSTRATION  INTERVENTIONS 


INTERVENTION  JOHNS  HOPKINS  PITTSBURGH  UCLA  SAN  DDE  GO  WASHINGTON 
CLINICAL  SCREENING 

Medical  History  x  x  x  x  x 

Physical  Exim 

height/weight  x  x  x  x  x 

blood  pressure/pulse  x  x  x  x  x 

vision  x  x  x  x 

bearing  x  x  x  x 

dental  x  x 

breast  exam  x  x 

pelvic  x  x 

digital  rectal  x  x 

gait/balance  x 
Other*  x  x 

Lab  Work 

hematocrit  x  x  x 

creatinine  x 

cholesterol  x  x  x  x 

thyroid  (TSH)  x 

fasting  blood  x 

sugar/glucose 

tolerance 

Pap  smear  x  x 

stool  hemoccult  x  x 

IMMUNIZATIONS 

influenza  x  x  x  x 

pneumococcus  x  x  x 

diphtheria-tetanus  x  x  x 

HEALTH  EDUCATION  PROMOTION 


nutrition 

x 

X 

X 

X 

X 

weight  reduction 

X 

X 

X 

X 

diabetes 

X 

smoking  cessation 

X 

X 

X 

X 

X 

alcohol  use 

X 

X 

X 

X 

X 

mental  health/sleep 

X 

X 

X 

X 

exercise 

X 

X 

X 

X 

oral  health 

X 

injury  prevention 

X 

X 

X 

X 

social  work 

X 

PT/OT 

X 

medication 

X 

X 

X 

X 

incontinence 

X 

X 

X 

planning  ahead 

X 

X 

other11 

"  Prychosocial/mental  health  screening  and  assessment 

b  San  Diego  health  promotion  also  included:  life  changes,  independent  living,  relaxation,  self 
care,  and  using  the  health  care  system.  UCLA  health  promotion  also  included  a  session  on 
lifestyle  and  social  locations. 
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Who  delivered  the  services.  In  some  projects  (Johns  Hopkins),  physicians 
were  responsible  for  clinical  screening  and  health  promotion  services;  in 
other  projects,  nurses  and  other  health  professionals  assisted  or  substituted 
for  physicians.  One  of  the  evaluation  objectives  was  to  compare  the  use  of 
physicians  versus  other  health  professionals  in  delivering  preventive  services. 
It  might  be  assumed  that  a  physician's  advice  on  health  behavior  carries 
more  weight  than  similar  advice  from  a  nurse.  However,  the  relative  costs 
of  physicians'  time  and  evidence  from  previous  research  that  many  physicians 
devalue  preventive  care  argue  for  the  involvement  of  non-physicians. 

Who  scheduled  the  services?  The  experimental  group  members  were 
responsible  for  scheduling  preventive  visits  in  some  projects  (Johns  Hopkins, 
Pittsburgh),  whereas  one  or  more  providers  were  responsible  for  others.  In 
assessing  the  feasibility  of  a  Medicare  prevention  benefit,  it  will  be 
informative  to  compare  results  between  the  two  models,  assuming  that  the 
beneficiary-initiated  approach  is  a  more  realistic  model  for  simulating  benefit 
implementation. 

Where  were  services  delivered?  UCLA  delivered  all  services  in  one  physical 
location,  but  the  other  projects  required  participants  to  seek  services  in 
different  locations  and  at  different  times. 

How  were  preventive  services  reimbursed?  Some  of  the  COBRA  projects 
(UCLA,  San  Diego,  and  the  hospital  clinic  component  of  the  Pittsburgh 
demonstration)  were  at  full  risk  under  capitated  payment  rates  for  the 
package  of  preventive  services  (see  Exhibit  3-2),  whereas  others  (Johns 
Hopkins,  Washington,  and  Pittsburgh's  physician  component)  arranged 
partially  unbundled  or  fee-for-service  payment  systems  that  imposed  less  risk. 
It  is  often  assumed  that  providers  look  for  ways  to  curtail  services  under 
fully  capitated  rates  to  avoid  the  negative  financial  impact  of  high  levels  of 
utilization.  In  the  COBRA  demonstration,  the  potentially  adverse  effect  on 
service  delivery  of  a  capitated  rate  may  be  controlled  if  services  are  provided 
in  central  location  and  can  easily  be  monitored  for  deviations  from 
intervention  protocols  by  the  project  UCLA  met  this  criterion,  but 
apparently  experienced  deficits  because  reimbursements  were  linked  to 
attendance  at  their  Health  Day,  not  to  total  experimentals.  Pittsburgh's 
hospital  clinics  represented  a  decentralized  and  less  readily  monitored 
system,  and  one  might  have  expected  to  find  a  greater  tendency  for  clinics 
to  limit  the  content  of  visits.  Pittsburgh's  physicians  were  paid  on  a  fee-for- 
service  basis,  with  a  cap  on  total  reimbursement  for  each  subject  Although 
highly  decentralized,  this  system  should  have  encouraged  providers  to  deliver 
all  parts  of  an  intervention  package. 
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EXHIBIT  3-2 


COBRA  MEDICARE  PREVENTION  DEMONSTRATION 
WATVERED  SERVICES  RATES  PER  PARTICTPA^Y  PROJECT 


EXPERIMENT  ALS  CONTROLS 


Johns  Hopkins 

Health  risk  appraisal  $18  00 

Screening  with  pap  $145.00 

Screening  without  pap  $142.00 

Counseling  $40.00 
Sm  Diego 

Health  risk  appraisal  g19  5Q 

Screening  and  health  promotion  $145  77 
UCLA 

Health  risk  appraisal  125  00 

Screening  and  health  promotion  $125  00 

Brnfamh 

Health  risk  appraisal  $30  qq 

Screening  and  health  promotion  -  hospital  Year  1  Year  2  _ 

cUnic  $150.00  $80.00 

Screening  and  health  promotion  -  physician  $150.00*  $45.00 
office 

Washington 

Health  risk  appraisal  $20  00 

Disease  prevention  $74  76 

Health  promotionb   $g8  52 

•  Reimbursement  represents  average  annual  per  capita,  up  to  $250.00  per  beneficiary. 
Sewces  included  under  ■screening"  and  'health  promotion"  are  as  indicated  in  Exhibit  4-1 
except  Washington.  Includes  blood  pressure/pulse;  vision;  and  bearing  in  health  promotion' 
rather  than  screening. 

J_Controlsparticipated  in  screening  and  health  promotion  in  March  and  April,  1991. 


$19.50 

$25.00 
$125.00c 

$30.00 
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Johns  Hopkins  physicians  were  paid  separately  for  screening  and  counseling. 
Because  Johns  Hopkins  physicians  normally  expected  fee-for-service  payment, 
the  potential  for  payment  effects  on  the  content  of  preventive  visits  was 
probably  greater  than  in  the  Washington  project,  where  physicians  and  other 
providers  operated  independent  of  reimbursement  and  where  Group  Health 
Cooperative  (GHC)  and  the  University  were  jointly  responsible  for  the  integrity 
of  the  research. 

Projects  implemented  specific  delivery  systems  in  the  following  ways: 

Johns  Hopkins:  After  completing  the  baseline  interview,  experimental  subjects  were 
sent  vouchers  for  an  initial  preventive  visit.  Beneficiaries  were  responsible  for 
scheduling  all  appointments.  However,  physicians  were  told  which  of  their  patients 
received  vouchers,  and  were  provided  profiles  constructed  from  the  baseline  health 
risk  data.  In  addition  to  the  initial  visit  each  subject  was  entitled  to  a  6-month 
followup  visit  for  education  and  counseling,  at  the  physician's  discretion.  The 
preventive  visit/followup  visit  sequence  was  repeated  in  the  second  demonstration 
year.  Project  investigators  encouraged  physicians  to  take  an  active  role,  by 
contacting  patients  who  failed  to  schedule  appointments. 

San  Diego:  Two  weeks  after  completion  of  the  baseline  assessment  interview, 
subjects  attended  a  clinic  screening  appointment,  provided  by  physicians  and  allied 
health  professionals  affiliated  with  Sharp  Rees-Stealy  Medical  Group  in  five 
locations.  This  appointment  was  scheduled  with  the  participant  by  project  staff  at 
the  baseline  health  evaluation  and  assessment  San  Diego  separated  immunization 
clinics,  scheduled  just  before  the  influenza  season,  from  the  rest  of  the  clinical 
intervention.  At  the  clinic  screening,  providers  encouraged  subjects  to  attend  health 
education  workshops.  Eight  separate  workshops  were  held  in  various  locations,  each 
conducted  by  a  professional  health  educator. 

UCLA:  Experimental  participants  were  told  after  completing  the  HRA  that  they 
would  receive  information  by  mail  about  a  special  Screening  and  Health  Promotion 
Clinic,  in  which  they  would  receive  feedback  on  the  results  of  the  HRA.  In  the 
mailing,  subjects  were  given  a  date  and  time,  with  the  option  to  reschedule  at  the 
their  convenience.  The  first  Health  Promotion  Clinic  was  held  on  a  weekend  in  May 
and  a  Saturday  in  November,  for  individuals  who  could  not  attend  the  May  session. 
This  4-hour  session,  held  in  a  single  location,  included  screenings,  a  targeted 
psychosocial  assessment,  feedback  to  participants,  health  education,  and  community 
referrals.  Transportation  was  provided  if  necessary.  Although  results  were  also 
reported  to  the  beneficiary's  primary  care  physician,  it  was  usually  the  patient's 
responsibility  to  follow  up  on  referrals. 

University  of  Pittsburgh:  After  completion  of  the  HRA  and  blood  draw, 
experimental  group  participants  received  a  chit  for  a  screening  appointment  and 
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were  assigned  at  that  time  to  one  of  three  screening  groups.  In  addition,  they 
received  a  letter  stating  that  their  HRA  results  were  ready  for  review  by  the  hospital 
or  physician,  depending  upon  which  experimental  group  they  were  enrolled  in,  and 
requesting  that  they  schedule  an  appointment.  Hospitals  and  physicians  received  the 
appropriate  HRA  results  as  well,  and  were  asked  to  schedule  appointments  with 
participants  who  failed  to  follow  through  on  their  own.  Recommendations  for 
education  interventions  were  based  on  results  of  the  HRA  and  screening.  Providers 
were  not  reimbursed  for  intervention  services  until  the  results  of  the  screening  were 
received  at  the  University. 

University  of  Washington:  Participating  clinics  scheduled  the  first  round  of  health 
promotion/disease  prevention  visits  for  experimental  subjects  after  completion  of  the 
baseline  survey.  In  two  clinics,  Downtown  and  Burien,  visits  were  delayed  3  to 
4  months  by  a  nurses'  strike.  Generally,  GHC  nurses  provided  the  initial  health 
promotion  visit,  which  included  an  HRA  discussions  about  priority  areas  for 
behavior  change  and  recommendations  for  followup  during  the  subsequent  disease 
prevention  visit.  Physicians  were  able  to  follow  up  on  priority  areas  identified  in  the 
initial  visit.  GHC  organized  classes  in  exercise,  planning  ahead,  hypertension 
management  and  hearing.  Providers  were  encouraged  to  recommend  the  classes,  but 
responsibility  for  registration  was  left  to  the  participant. 

3.2  HRA 

Projects  collected  HRA  data  on  all  experimentals  and  controls  (to  identify  behavior  and 
conditions  that  put  beneficiaries  at  risk  of  preventable  medical  events).  However,  the 
control  group  participants  did  not  receive  direct  feedback  on  their  HRA  results.  The 
information  provided  by  experimentals  was  often  used  to  structure  the  intervention.  Each 
project  designed  a  questionnaire  to  collect  information  on  beneficiary  demographic 
characteristics  and  health  status.  In  particular,  topic  areas  addressing  health  status  and 
relative  risk  included: 

Health  Habits:  exercise,  smoking,  alcohol  use,  sleep,  diet/nutrition 

Injury  Prevention:  history  of  falls,  home  and  environmental  safety, 
rehabilitation  needs 

General  Health:  existing  conditions,  perceived  health  status, 
medication  use,  incontinence 

Psychosocial/Mental  Health:  quality  of  life,  cognitive  status,  depression, 
social/family  networks 
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Most  projects  established  threshold  levels  for  specific  parts  of  the  profile  (e.g.,  smoking 
or  alcohol  consumption)  to  identify  whether  the  beneficiary  was  at  great  risk  for  certain 
conditions  and  then  used  computer  screens  to  identify  risk  (e.g.,  a  beneficiary  consuming 
more  than  five  alcoholic  beverages  at  a  time  might  be  considered  to  be  at  risk). 

The  COBRA  projects  used  the  HRA  data  in  various  ways. 

Johns  Hopkins:  Data  from  the  lifestyle  risk  assessment  component  of  the  baseline 
survey,  completed  through  phone  interviews,  were  summarized  in  Health  Behavior 
Profiles.  Profiles  of  experimental  group  members  were  mailed  to  the  appropriate 
participating  physicians.  The  profiles  summarized  responses  to  specific  questions, 
without  comment  and  without  specification  of  risk  thresholds. 

San  Diego:  All  participants  completed  paper-and-pencil  questionnaires  as  part  of 
the  baseline  data  collection.  Two  instruments  were  used:  a  "Life  Assessment 
System,"  which  included  demographic,  health  history  and  habits/behaviors;  and  a 
"Health  Status  Inventory,"  which  covered  health  status  and  health  care  utilization 
history.  The  Center  for  Epidemiological  Studies-Depression  (CES-D)  scale  and  a 
brief  check  of  height,  weight  and  blood  pressure  were  completed  by  trained  project 
staff  in  various  locations  in  the  community.  The  baseline  data  were  passed  through 
a  computer  program  which  identified  specific  risk  profiles,  and  the  results  were  sent 
to  the  experimental  subjects  only. 

UCLA:  At  the  Screening  and  Health  Promotion  Clinic,  risk  factors  identified  for 
experimental  subjects  through  the  HRA  were  reviewed  with  participants.  The  HRA 
was  also  used  to  refer  people  to  the  appropriate  health  education  section  at  the 
Clinic.  A  summary  of  the  HRA,  which  included  screening  information,  was  also  sent 
to  the  participant's  physician. 

University  of  Pittsburgh:  Risk  factors  identified  for  experimental  subjects  through 
the  HRA  were  summarized  and  sent  either  to  the  hospital  (treatment  group  1)  or 
the  physician  (treatment  group  2).  The  HRA  results  were  combined  with  the  health 
screening  results,  and  compared  to  thresholds  to  determine  eligibility  for  the 
interventions.  Therefore,  not  all  Pittsburgh  subjects  were  eligible  for  every 
Pittsburgh  intervention. 

University  of  Washington:  Project  investigators  decided  to  use  HRA  data  collected 
in  the  baseline  questionnaire  to  set  thresholds  that  triggered  recommendations  for 
specific  interventions  during  either  (or  both)  the  health  promotion  and  disease 
prevention  visits.  Each  participant's  profile  was  documented  in  a  Provider's  Guide 
and  made  available  to  nurses  and  physicians  who  provided  the  intervention  services. 
The  Provider's  Guide  also  offered  direction  on  how  the  nurse  or  physician  might 
proceed  with  counseling  or  medical  evaluations. 
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3.3  Clinical  Screening 

The  first  major  component  of  the  intervention  package  included  clinical  screenings  for 
preventable  and  treatable  diseases,  with  an  emphasis  on  reducing  disability  and 
dependency.  All  projects  collected  a  brief  medical  history  followed  by  a  limited  physical 
exam.  In  four  of  the  five  projects  (Johns  Hopkins,  Pittsburgh,  San  Diego,  and 
Washington),  a  set  of  laboratory  tests  and  immunizations  were  ordered.  However,  there 
were  many  differences  among  the  projects  in  the  specific  exams  and  lab  work  that  were 
performed  and  in  the  type  of  provider  conducting  the  exam. 

All  of  the  projects  except  UCLA  included  influenza  immunizations  in  the  intervention 
package.  In  three  projects  (Johns  Hopkins,  San  Diego,  and  Washington),  pneumococcal 
and  diphtheria-tetanus  immunizations  were  also  provided.  Generally,  the  immunizations 
were  only  offered  if  the  beneficiary  had  not  recently  received  one  within  the  appropriate 
schedule  of  the  immunization  (e.g.,  every  10  years  for  diphtheria-tetanus). 

The  order  and  content  of  clinical  screening  services  varied  among  the  projects. 

Johns  Hopkins:  Subjects  received  a  screening  evaluation,  history,  physical, 
immunizations,  laboratory  evaluation  and  physician  review  in  their  preventive  visit. 
A  nurse  could  conduct  the  evaluation,  but  physicians  were  expected  to  provide  the 
rest  of  the  clinical  services.  Some  physicians  reportedly  delayed  or  canceled 
components  that  they  had  performed  recently  or  that  should  have  been  deferred  to 
a  more  appropriate  time  (i.e.  immunizations).  Physician  payment  was  reduced  if  Pap 
smears  were  not  performed. 

San  Diego:  After  limited  physical  checks  performed  at  baseline  data  collection, 
nurses  and  other  health  professionals  conducted  more  intensive  histories  and 
screenings  at  the  clinical  visit  The  team  physician  reported  abnormal  findings  to  the 
subject's  own  primary  physician.  Referrals  to  other  programs,  e.g.,  smoking 
cessation,  were  provided,  and  participants  were  scheduled  for  and  provided  with 
manuals  used  in  the  health  promotion  workshops. 

UCLA:  The  Screening  and  Health  Promotion  Clinic  provided  screening  and  health 
promotion  services  in  one  place  at  one  time.  Clinical  screens  included  the  usual 
checks  (height,  weight,  blood  pressure),  and  hearing  and  vision  checks,  conducted  by 
medical  assistants  supervised  by  a  nurse  practitioner  or  physician.  A  dentist 
conducted  oral  examinations  and  oral  cancer  screenings.  Social  workers  conducted 
screenings  for  problems  with  alcohol,  mental  health,  and  social  isolation.  Physical 
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or  occupational  therapists  examined  pre-screened  subjects  for  rehabilitation  needs, 
such  as  gait  training  or  assistance  devices.  After  the  screening  session,  subjects  also 
met  with  a  nurse  practitioner  for  an  assessment  triage  and  review  of  risk  status  for 
targeting  the  health  promotion  workshops  that  were  held  immediately  after  the 
clinical  screening. 

University  of  Pittsburgh:  At  the  screening  visit,  the  physician  reviewed  risk  factors 
identified  through  the  HRA,  took  some  vital  signs,  and  retested  individuals  identified 
as  being  at  risk  for  depression  and  dementia.  Services  not  considered  part  of  the 
intervention  were  also  performed  and  reported  as  part  of  the  screening  but  not  billed 
as  waivered  services  (services  considered  followup  to  conditions  detected  in  the 
screenings). 

University  of  Washington:  Unlike  the  other  four  projects,  most  of  the  clinic 
screening  component  (excepting  vision,  hearing  and  blood  pressure  checks)  came 
after  an  initial  counseling  visit.  A  nurse  or  physician  conducted  the  screening 
evaluation,  which  included  a  review  of  immunization  status,  and  a  medical  history 
and  physical  examination,  which  included,  among  other  components,  a  breast 
examination  for  female  subjects,  evaluations  for  nutritional  disorders  and 
incontinence  and  orders  for  lab  work  and  immunizations.  Primary  care  followup  was 
not  part  of  the  intervention. 


25 


3.4 


Health  Education  and  Promotion 


While  health  education  and  promotion  issues  were  generally  covered  as  part  of  the 
clinical  screening  during  the  physical  exam,  some  projects  held  formal  workshops  on 
specific  topics,  some  projects  scheduled  separate  visits  during  which  individual  counseling 
sessions  were  conducted,  and  others  used  a  combination  of  approaches.  Each  site 
concentrated  its  health  education  and  promotion  activities  on  six  or  seven  priority  risk 
areas.  All  projects  promoted  smoking  cessation.  Other  common  issues  targeted  for  health 
education  included  nutrition  and  diet,  alcohol  use,  mental  health  and  sleep  disturbances, 
and  exercise  and  injury  prevention. 

Projects  implemented  education  and  counseling  interventions  in  various  ways. 

Johns  Hopkins:  Investigators  expected  the  health  promotion  intervention  to  be  part 
of  a  one-on-one  session  between  patient  and  physician  in  an  office  or  clinic  setting. 
To  support  this  effort,  a  substantial  continuing  medical  education  effort  was 
implemented  by  the  Center  For  Medical  Education  of  the  State  medical  society. 
Education  and  counseling  was  expected  to  be  part  of  the  initial  prevention  visit,  with 
additional  counseling  provided  in  the  6-month  followup,  as  needed.  However,  some 
physicians  devoted  the  entire  preventive  visit  to  counseling  patients  they  had  recently 
screened  and  examined  as  part  of  their  regular  practice. 

San  Diego:  The  health  promotion  intervention  was  designed  by  Health  Wise,  Inc. 
and  included  a  series  of  workshops:  "Growing  Wiser"  workshops  focused  on 
memory,  mental  alertness,  life  changes,  substance  abuse  prevention  and  independent 
living;  "Growing  Younger"  workshops  focused  on  exercise,  nutrition,  relaxation,  self- 
care  and  using  the  health  care  system.  The  project  deliberately  located  workshop 
sessions  in  non-medical  settings  (senior  centers,  business  conference  rooms)  to  stress 
the  wellness  (rather  than  sickness)  theme.  Counselors  followed  up  experimental 
subjects  by  telephone,  to  track  and  encourage  recommended  behavior  change,  to 
provide  counseling  on  problems  encountered  and  to  check  on  follow-through  with 
referrals. 

UCLA:  Health  promotion  activities  were  included  in  the  Screening  and  Health 
Promotion  Clinic.  In  Year  One,  all  participants  received  a  large-group  educational 
session  about  "How  to  talk  to  your  doctor."  In  Year  Two,  all  experimental 
participants  received  an  education  session  on  immunizations.  After  meeting  with  the 
geriatric  nurse  practitioner  for  an  assessment  and  a  one-on-one  health 
promotion/counseling  session  concerning  the  Geriatric  HRA  and  results  from  the 
clinical  screening  (height,  weight,  blood  pressure,  vision,  hearing,  dental), 
experimental  subjects  were  allowed  time  to  participate  in  two  additional  health 
education  sessions.  The  sessions  that  were  available  in  the  first  year  were  diet  and 
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nutrition,  dental  health,  exercise  and  fitness,  home  safety,  lifestyle  and  social 
relationships,  and  smoking  cessation.  In  the  second  year,  the  smoking  cessation 
session  was  discontinued  due  to  very  low  participation  in  the  first  year,  and  two 
additional  sessions  were  added,  one  on  hearing  and  another  on  visual  impairment, 
with  an  emphasis  on  various  adaptation  devices  and  techniques  for  these  common 
sensory  impairments  in  elderly  people. 

University  of  Pittsburgh:  If  screening  results  indicated  that  experimental  subjects 
were  at  risk  for  certain  conditions,  they  received  a  letter  and  chits  for  education 
sessions  addressing  the  critical  issues,  which  covered  nutritional  counseling,  weight 
reduction,  evaluation  for  dementia  or  depression,  alcohol  counseling,  and  smoking 
cessation.  These  areas  were  selected  to  reflect  prevalence  of  risk  factors  in  the 
target  population  and  the  existence  of  measurable  outcomes.  Providers  were 
responsible  for  contacting  subjects  and  arranging  their  participation.  Physicians  were 
offered  training  in  the  interventions.  Physicians  could  refer  subjects  to  the  hospital 
clinics  for  these  services  in  which  health  educators  conducted  the  sessions. 

University  of  Washington:  Investigators  prioritized  health  promotion  interventions, 
according  to  expected  utilization  savings  and  potential  for  affecting  health  and 
behavior.  Exercise,  nutrition  and  planning  ahead,  which  ranked  in  the  top  five  with 
project  staff,  were  considered  high  priority  for  inclusion  in  discussions  during  the 
counseling  sessions.  GHC  provided  classes  in  health-related  behavior  for 
participants,  who  attended  on  a  voluntary  basis.  Primary  care  follow  up  of  abnormal 
findings  discovered  through  the  health  promotion  and  disease  prevention  visits  was 
implemented  as  part  of  routine  care  at  GHC. 
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4.0  RESEARCH  DESIGN,  SAMPLING  AND  MEASUREMENT  ISSUES 
This  interim  report  evaluates  the  effects  of  the  demonstration  within  the  first  year  on 

experimental  group  utilization  of  waivered  preventive  services,  Medicare  expenditures,  and 
beneficiary  utilization  of  acute  care  services,  health  and  functional  status,  and  health- 
related  behavior.  The  final  report  will  add  analyses  that  incorporate  2  more  years  and  will 
draw  conclusions  about  the  cost-effectiveness  of  a  benefit  to  extend  Medicare  coverage  of 
a  preventive  services  package. 

Interpreting  the  initial  findings  from  the  COBRA  Medicare  Prevention  Demonstration 
requires  some  understanding  of  the  original  research  design,  the  sampling  strategies 
adopted  by  the  projects,  and  shortcomings  of  the  demonstration  data.  This  chapter 
describes  steps  taken  to  meet  the  methodological  challenges  posed  by  the  COBRA 
Demonstration.  Some  of  these  challenges  have  been  addressed  in  this  report.  Others  will 
be  addressed  in  the  final  report  of  the  project  on  the  cost-effectiveness  of  preventive 
services  for  the  Medicare  program. 

4.1  Data  Pooling 

The  COBRA  Medicare  Prevention  Demonstration  projects  shared  certain  features. 
Each  assigned  recruited  enrollees  randomly  to  experimental  and  control  groups.  At  intake 
into  the  study,  each  project  collected  baseline  demographic,  socioeconomic,  health  status, 
and  health  behavior  data  on  both  experimental  and  control  group  members.  From  1  to 
2  years  later,  investigators  collected  essentially  the  same  information  in  subsequent  follow- 
up  surveys.  After  completing  baseline  surveys,  the  projects  offered  waivered  preventive 
services  to  experimental  group  members. 

However,  in  another  sense,  the  demonstration  consists  of  five  quite  different  projects. 
Neither  the  Congress  nor  HCFA  attempted  to  impose  on  the  projects  complete  uniformity 
in  the  preventive  services  package  offered  to  experimentals,  in  the  risk  profiles  of 
participating  beneficiaries,  or  in  the  measures  investigators  might  choose  to  determine  the 
effects  of  the  demonstration.  Although  the  COBRA  legislation  included  language  on  the 
content  of  the  preventive  services  package  and  on  the  overall  demonstration  design,  the 
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projects  responded  to  what  they  viewed  as  encouragement  to  experiment  with  considerable 
creativity.  While  offering  promise  of  gains  in  basic  research  into  health  behaviors  and 
outcomes  among  the  elderly,  this  design  posed  a  challenge  to  the  cross-cutting  evaluation. 

To  facilitate  pooling  of  data  across  projects,  the  cross-cutting  evaluation  contractor 
worked  with  the  individual  projects  to  develop  a  minimum  data  set  (MDS)  for  the 
demonstration.  In  some  cases,  the  projects  agreed  on  common  definitions.  In  others,  the 
evaluation  contractor  developed  coding  systems  to  standardize  diverse  measures  across 
projects.  For  example,  the  evaluator  re-coded  measures  of  living  arrangement,  treated 
differently  by  each  project,  into  a  simple  two-valued  measure  (lives  alone,  lives  with 
someone).  The  MDS  incorporates  data  collected  by  each  project  that  defines  certain 
characteristics  of  the  interventions  (the  package  of  preventive  services),  the  socioeconomic 
and  demographic  characteristics  of  the  enrollees,  measures  of  functional  status,  and 
measures  of  health  behavior.  The  evaluation  contractor  also  defined  a  minimum  set  of 
service  utilization  measures,  to  facilitate  comparisons  of  the  managed  care  projects' 
utilization  data  with  similar  data  for  the  fee-for-service  projects  taken  from  Medicare 
claims  and  eligibility  files. 

In  spite  of  these  efforts,  the  MDS  represents  only  a  partial  solution  to  the  challenges 
posed  by  diversity  within  the  demonstration. 

Because  the  projects  developed  different  service  packages,  different  methods  for 
delivering  services,  and  different  data  collection  instruments  and  techniques,  real 
differences  in  the  demonstration  interventions  will  remain.  HCFA  adopted  the  following 
strategies  to  accommodate  this  situation: 

By  the  end  of  the  study,  each  project  will  complete  an  evaluation  that  will 
capture  the  unique  characteristics  of  its  own  program. 

The  cross-cutting  evaluator  will  conduct  analyses  based  on  data  pooled  across 
all  projects  on  a  portion  of  the  MDS  common  to  both  managed  care  and  fee- 
for-service  programs;  estimates  of  the  differences  between  experimentals  and 
controls  will  be  adjusted  for  program  type,  to  account  for  effects  associated  with 
managed  care  versus  fee-for-service  systems,  and  for  specific  project,  to  account 
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for  the  effects  of  otherwise  unmeasurable  differences  in  the  programs,  in  the 
demographic  characteristics  of  enrollees  and  in  the  health  services  markets  of 
the  five  projects. 

In  addition,  the  cross-cutting  evaluation  will  report  separate  analyses  based  on  data 
pooled  within  projects  grouped  by  program  type,  with  Johns  Hopkins,  Pittsburgh,  and 
UCLA  in  a  "fee-for-service"  group,  and  Washington  and  San  Diego  in  a  "managed  care" 
group. 

4.2  Factors  Affecting  The  Internal  Validity  of  Demonstration  Findings: 

Enrollee  Sampling 

The  COBRA  demonstration  projects  assigned  enrollees  randomly  to  experimental  and 
control  groups  to  minimize  variation  between  experimental  and  control  groups  in 
characteristics,  such  as  age,  health  status,  and  prior  health  care  utilization,  that  might 
influence  participant  behavior. 

The  design  of  each  demonstration  project  dictated  the  source  for  recruiting  beneficiaries 
for  participation.  In  the  three  provider-based  projects  (UCLA,  San  Diego,  and 
Washington),  beneficiaries  were  recruited  from  the  case  lists  of  participating  physicians  or 
HMO  clinics.  The  two  population-based  projects  (Johns  Hopkins  and  Pittsburgh)  recruited 
beneficiaries  living  in  the  ZIP  Codes  or  counties  targeted  for  the  demonstration. 
Beneficiaries  recruited  for  the  Johns  Hopkins  project  also  had  to  identify  as  their  primary 
physician  one  of  the  physicians  who  had  agreed  to  participate  in  the  project 

HCFA  and  the  COBRA  projects  jointly  established  eligibility  criteria  for  participating 
beneficiaries.  All  beneficiaries  were  required  to  be  enrolled  in  the  Supplementary  Medical 
Insurance  (Part  B)  program;  coverage  was  verified  annually  throughout  the  demonstration 
by  HCFA.  Projects  also  stipulated  additional  criteria  to  reduce  the  risk  of  contaminating 
the  study  design  and  to  facilitate  data  collection.  For  example,  all  projects  excluded  the 
institutionalized  and  homebound  elderly,  and  set  minimum  age  criteria  of  65  years 
(disabled  and  End  Stage  Renal  Disease  Medicare  beneficiaries  were  excluded).  One 
project  (Pittsburgh)  excluded  beneficiaries  over  the  age  of  86  years. 
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Once  the  target  population  was  identified,  each  project  defined  a  sampling  frame  from 
which  beneficiaries  were  recruited  (see  Exhibit  4-1).  San  Diego,  UCLA,  and  the  University 
of  Pittsburgh  recruited  from  the  entire  target  population.  The  University  of  Washington 
and  Johns  Hopkins,  on  the  other  hand,  sampled  from  the  population  to  define  a 
recruitment  frame. 

As  shown  in  Exhibit  4-1,  the  total  number  of  demonstration  enrollees  is 
14,349,  approximately  half  of  which  were  assigned  to  the  experimental  group.  Pittsburgh 
had  two  experimental  groups  (one  group  received  intervention  services  from  a  physician; 
the  other  group  received  intervention  services  from  a  hospital).  For  this  reason,  the 
experimental  group  in  Pittsburgh  was  approximately  twice  the  size  of  the  control  group. 

Although  widely  considered  to  be  superior,  to  the  extent  that  it  eliminates  bias  due  to 
self- selection  into  the  group  receiving  the  demonstration  intervention,  a  demonstration 
design  that  incorporates  random  assignment  may  be  weakened  by  spill-over  effects  and  by 
differential  attrition. 

Spill-Over  Effects 

If  enrollees  are  randomly  assigned  from  the  same  geographical  area  or  institutional 
setting,  it  may  be  impossible  to  prevent  spill-over  of  publicity  about  the  intervention  from 
experimentals  (the  intended  target)  to  controls.  When  part  of  the  intervention  is  itself 
advice,  e.g.,  improving  health  behavior,  controls  may  respond  to  the  message.  Participation 
in  baseline  data  collection  through  HRAs  may  cause  control  group  members  to  reassess 
and  change  their  behavior,  without  benefit  of  special  preventive  services.  This 
"contamination"  of  the  control  group  reduces  differentials  in  outcomes  between 
experimentals  and  controls  and  complicates  the  process  of  detecting  effects  of  the 
demonstration. 
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EXHIBIT  4-1 
COBRA  Medicare  Prevention  Demonstration 
Sample  Selection 


Johns  Pittsburgh            UCLA  San  Diego  Washington 
Hopkins 

Sampling  Frame           12,111  23,000                4,360  11,140  5,013 

Medicare  Medicare  Medicare  Medicare  A  random  sample 

beneficiaries  beneficiaries  beneficiaries  who  beneficiaries  of  Medicare 

residing  in  7  ZIP  residing  in  5  rural  are  patients  of  enrolled  in  the  beneficiaries 

Code  areas  of  counties  of  Western  physicians  affiliated  Secure  Horizons        .  enrolled  in  I  of  4 

Baltimore  City,  Pennsylvania,  age  with  the  Clinical  HMO  and  receiving  GHC  clinics, 

stratified  by  type  65-79,  stratified  by  Faculty  care  from  the  Sharp 

of  provider.  high  and  low  users.  Association.  Rees-Stealy  Medical 


All  Sites 

Total  Sample  Size  4,236  3,880  1,911  1,800  2,524  14,349 

Experimentab  2,119  2,655  973  899  1,270  7,915 

Controls  2,117  1,225  938  901  1,254  6,434 


Source:  COBRA  Medicare  Prevention  Demonstration  Case  Study  and  Minimum  Data  Set  (MDS). 


It  is  difficult  to  be  certain  that  spill-over  occurred,  although  the  projects  were  conscious 
of  it  as  a  potential  problem.  For  example,  Johns  Hopkins  minimized  publicity  about  the 
demonstration  in  its  target  areas  of  Baltimore  to  reduce  the  effects  of  contamination. 
Johns  Hopkins  investigators  were  also  anxious  to  forestall  heightened  expectations  among 
controls  and  among  those  who  would  be  ineligible  for  various  reasons.  Conversely, 
Pittsburgh,  facing  a  difficult  enrollee  recruitment  task  in  rural  Western  Pennsylvania, 
conducted  an  intensive  publicity  campaign,  preferring  to  maximize  participation  at  the 
possible  expense  of  changing  control  group  behavior.  To  address  this  issue  in  the  final 
report,  HCFA  will  compare  changes  in  outcomes  among  control  group  members  across 
projects,  to  relate  the  behavior  of  controls  to  methods  used  by  the  sites  to  publicize  the 
demonstration.  At  this  time,  there  is  no  direct  evidence  that  any  spill-over  occurred. 

Attrition  Bias 

Attrition  may  threaten  the  validity  of  measured  demonstration  effects  in  two  ways: 

If  attrition  is  concentrated  equally  among  certain  types  of  enrollees  in 
both  experimental  and  control  groups  (for  example,  beneficiaries  at  high 
risk  for  hospitalization),  estimates  of  demonstration  effects  may  change 
in  size  and  direction  (if  risk  is  related  to  use  of  preventive  services),  but 
they  will  not  be  biased; 

If  attrition  affects  controls  and  experimentals  unequally  (more 
experimentals  than  controls  drop  out,  more  high  risk  experimentals  drop 
out),  estimates  of  demonstration  effects  may  be  biased. 

The  COBRA  projects  recruited  demonstration  enrollees  and,  after  gaining  their  consent, 
administered  interviews  to  collect  baseline  data  that  included  an  HRA.  Enrollees  who 
completed  the  baseline  interviews  were  randomly  assigned  to  experimental  and  control 
status  and  are  considered  study  subjects. 

For  assessing  the  implications  of  attrition,  non-participants  are  defined  as  enrollees  who 
failed  to  respond  to  the  follow-up  survey.  The  length  of  time  between  the  baseline  and 
follow-up  surveys  varied  among  the  projects,  ranging  from  about  1  year  (San  Diego  and 


33 


UCLA)  to  2  years  (Pittsburgh,  Johns  Hopkins,  and  Washington).  The  length  of  time 
between  surveys  may  contribute  to  differences  in  participation  rates  among  projects. 

As  shown  in  Exhibit  4-2,  in  all  projects  except  Pittsburgh,  where  follow-up  procedures 
were  still  underway  when  this  report  was  produced,  over  70  percent  of  all  enrollees  were 
identified  at  follow-up.  Of  particular  note  is  the  high  percentage  of  beneficiaries  identified 
in  Washington  where  the  length  of  time  between  interviews  was  among  the  highest 
(2  years).  Well  over  90  percent  of  controls  and  experimental  in  Washington  continued  to 
participate  in  the  demonstration  at  the  time  of  the  follow-up  interview. 

The  percentage  of  beneficiaries  continuing  to  participate  in  the  demonstration  across 
all  projects  at  follow-up  is  significantly  higher  among  control  participants  (80  percent)  than 
among  experimental  participants  (74  percent).  While  this  pattern  is  evident  among  all 
projects  except  Johns  Hopkins,  the  difference  is  relatively  small  (about  3-4  percent  more 
controls  were  participating  at  follow  up  compared  to  experimentals)  in  San  Diego,  UCLA, 
and  Washington.  The  largest  difference  can  be  seen  in  Pittsburgh  where  approximately 
72  percent  of  controls  and  59  percent  of  experimentals  are  included  in  the  follow-up 
sample.  This  difference  is  attributable  to  the  fact  that  the  Pittsburgh  project  staff  had 
completed  and  keypunched  about  63  percent  of  all  follow-up  interviews  as  of  February 
1992. 3  As  a  result,  experimental  enrollees  are  underrepresented  in  the  follow-up  sample 
for  the  Pittsburgh  project. 

Information  on  enrollees'  reasons  for  no  longer  participating  in  the  demonstration  was 
not  systematically  collected  by  the  five  demonstration  projects.  However,  using  the  HCFA 
eligibility  file,  participants  who  died  before  the  follow-up  interview  (see  Exhibit  4-2)  were 
identified.  With  the  exception  of  Johns  Hopkins,  a  relatively  small  percentage  (less  than 
2  percent)  of  the  participants  died  before  the  follow-up  survey.  In  contrast,  two  to  three 


The  Pittsburgh  project  has  since  completed  and  keypunched  3,260  followup  interviews,  representing  85  and 
83  percent  of  experimental  and  control  enrollees,  respectively. 
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EXHIBIT  4-2 


COBRA  Medicare  Prevention  Demonstration  Evaluation 


Participation  Status  of  Medicare  Beneficiaries 
By  Treatment  Group  By  Site 


States 

AH  Sites 
Eautri- 
«a-7.9IS)  <a-*.434) 

Johns  Hopkins 

Esatri- 

mr*4»l  C—tr»t 
(■  =  2.1  IV)  (a-2.117 

Pittsburgh 
Eincri- 

■MiHat  CMtnl 
(•.  =  2.455)  (a-1.225) 

UCLA 

E«s*rt- 

(■-V7J)  (i.=M7) 

San  Diego 

Eipcri- 

mmtal  Cwtfr«4 
(n-tVf)  (a-9tl) 

Washington 

Eiptri- 
<u«  1.279)     (a- 1.254) 

Participating  at  Followup 

73.5%' 

80.1% 

74.2% 

72.9% 

59.0% 

71.6%" 

82.9% 

86.2%* 

75.0% 

78.8%* 

94.7% 

97.1%" 

Not  Participating  at 

26.5% 

19.8% 

25.8% 

27.1% 

41.0% 

28.4% 

17.1% 

13.8% 

25.0% 

21.2% 

5.4% 

2.9% 

Followup 

Dead  at  Followup 

2.1% 

2.6%* 

8.5% 

ll.6%- 

1.6% 

18%' 

1.9% 

1.8% 

1.8% 

.7%' 

.!■ 

0* 

Lost  at  Followup 

24.4% 

17.2%" 

17.3% 

15  5% 

39.4% 

26.5%" 

15.2% 

12.0%* 

23.3% 

20.5%" 

5.3% 

2.9%" 

Source:  COBRA  Medicare  Prevent  iou  Demonstration  Minimum  DaU  Set. 

•  Differences  between  treatment  group*  m  aignificant  at  the  .05  level 
Differences  between  treatment  group*  are  aignificant  at  the  .01  level. 

*  Washington  was  in  process  of  tracing  deaths  in  the  experimental  and  control  samples  at  the  lime  this  report  was  written. 


EXHIBIT  4-3 


COBRA  Medicare  Prevention  Demonstration  Evaluation 

Percentage  Of  Medicare  Beneficiaries  Participating  In  The  Demonstration  At  Baseline 
And  Followup  By  Selected  Socio- Demographic  Characteristics 

Across  All  Sites 


Baseline  Followup 

Experimental  Control  Experimental  Control 

(n  =  7915)  (n  =  6434)  (n  =  5821)  (n  =  5156) 

59.2%  59.7%  60.8%  60.4% 


Female 

Over  80  Years  8.3% 

White  94.1% 

Married  60.0% 

Alone  30.3% 

Lives  in  Special  3.3% 
Residence  for  Elderly 

Some  College  Education  31.2% 

Retired  73.4% 

Highest  Income  5.1% 


Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set. 
Note:  Percentage!  are  based  oa  rjbaerratkma  without  missing  values. 


10.3%**  7.8%  8.4% 

91.8%**  93.8%  91.8%** 

58.2%*  57.5%  57.5% 

31.1%  32.9%  31.9% 

3.6%  3.3%  3.9%  + 

33.4%**  34.4%  36.4%* 

71.3%**  73.9%  73.0% 

5.7%  6.6%  7.3% 


+ 
» 


Differences  between  treatment  groups  are  significant  al  the  0. 10  level. 
Differences  between  treatment  groups  are  significant  at  the  .05  level 
Differences  between  treatment  groups  are  significant  al  the  .01  level. 


times  as  many  participants  (4  percent  of  experimental  and  6  percent  of  controls)  in  Johns 
Hopkins  died  between  the  baseline  and  follow-up.  This  may  be  related  to  the  longer  time 
period  between  the  two  interviews  (2  years),  combined  with  the  fact  that  participants  in  the 
Johns  Hopkins  project  were  older  on  average  than  participants  in  the  other  projects. 

Differential  rates  of  attrition  on  certain  characteristics  lead  to  some  changes  in  the 
characteristics  of  experimentals  and  controls  between  baseline  and  follow-up  data 
collection.  On  most  measured  characteristics,  however,  changes  were  small  and  statistically 
insignificant.  For  example,  while  slightly  more  women  continued  to  participate 
in  the  demonstration  (59  percent  at  baseline  and  60  percent  at  follow  up),  the  percentage 
of  females  participating  in  the  demonstration  was  similar  between  experimental  and  control 
groups  for  both  baseline  and  follow-up  samples  (Exhibit  4-3).  Similarly,  while  significantiy 
more  control  participants  were  minority  (8.2  percent)  compared  to  the  proportion  of 
minority  experimentals  (5.9  percent)  at  baseline,  the  difference  in  racial  composition  is  also 
significantly  higher  among  controls  (8.2  percent)  compared  to  experimentals  (6.2  percent) 
in  the  follow-up  sample.  This  pattern  of  differences  or  similarities  between  both 
experimental  and  control  groups  at  baseline  and  follow  up  is  consistent  for  most 
demographic  variables. 

While  more  elderly  (over  80  years)  were  in  the  control  group  than  in  the  experimental 
group  at  baseline  and  followup,  the  difference  was  significant  only  at  baseline  and  not  at 
follow  up.  Similarly,  relatively  fewer  controls  were  married  or  completely  retired  at 
baseline,  but  essentially  the  same  between  groups  at  follow  up. 

Although  non-random  attrition  may  be  a  problem  for  the  final  analyses  of  this  project, 
it  is  too  soon  to  determine  with  certainty  how  many  of  those  apparently  lost  to  follow  up 
may  remain  active  and  will  eventually  be  re-contacted  for  data  collection  purposes. 

The  Demonstration  Intervention 

Experimental  group  members  were  "exposed"  to  an  intervention  that  involved 
information  (that  free  preventive  services  were  being  made  available  through  the 
demonstration)  and  service  provision  for  those  who  elected  to  act  on  this  information.  In 
turn,  participants  might  choose  some  or  all  of  the  available  demonstration  services.  It 
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might  seem  reasonable  to  define  the  experimental  intervention  to  include  actual  use  of 
services,  to  capture  the  effectiveness  of  those  services. 

However,  a  valid  test  of  the  effectiveness  of  a  Medicare  prevention  benefit  should 
include  all  experimentals,  regardless  of  whether  or  not  they  actually  used  preventive 
services.  Net  Medicare  program  expenditures  under  a  new  prevention  benefit  would  be 
determined  both  by  participation  and  by  the  savings  potential  of  preventive  health  care. 
This  approach  recognizes  that  the  demonstration  intends  to  treat  all  eligible  experimentals, 
and  is  correspondingly  known  in  the  research  literature  as  the  "intent-to-treat"  model  (Peto 
and  colleagues,  1976).4 

The  intent-to- treat  model  preserves  the  advantages  of  randomization,  which  would  likely 
be  lost  if  the  intervention  were  more  narrowly  defined  to  require  use  of  demonstration 
preventive  services.  Not  all  experimentals  will  participate  fully  by  using  some  or  all  of  the 
preventive  services  offered  through  the  demonstration.  Those  who  do  not  participate  may 
differ  in  certain  characteristics  from  those  who  do.  If  these  characteristics  are  important 
determinants  of  some  of  the  outcomes  under  study,  this  self-selection  into  user  and  non- 
user  groups  could  bias  estimates  of  treatment  effects.  Contrasts  between  all  experimentals 
and  controls  within  the  intent-to-treat  model  are  unaffected  by  selection,  because  enrollees 
are  randomly  assigned  to  these  groups.  However,  contrasts  between  experimentals  who 
choose  to  use  services  and  controls  may  be  biased  because  it  will  be  difficult  to  find  that 
subgroup  of  controls  most  like  the  experimental  users,  particularly  in  the  characteristics 
that  predispose  individuals  to  use  preventive  services. 

This  argument  does  not  mean  that  the  evaluation  will  ignore  the  effects  of  preventive 
services  use.  Clearly  an  understanding  of  the  net  effects  on  behavior  and  health  outcome 
of  clinical  preventive  and  health  promotion  and  educational  services  will  be  critical  to  an 
informed  decision  about  a  Medicare  prevention  benefit  A  long-term  goal  of  the  evaluation 
will  be  to  study  more  closely  the  characteristics  of  users  and  non-users  and  to  develop 
appropriate  statistical  methods  to  correct  for  selection  effects. 


Peto,  R.  et  al.  "Design  and  analysis  of  randomized  clinical  trials  requiring  prolonged  observation  of  each 
patient.  I.  Introduction  and  design."  British  Journal  of  Cancer.  34:585-612(1976). 
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For  this  interim  report,  however,  the  options  open  to  the  evaluator  were  limited.  In  the 
period  covered  by  the  interim  report,  not  all  experimental  enrollees  fully  participated  by 
using  demonstration  services.  However,  some  of  these  might  participate  before  the  end 
of  the  demonstration.  Therefore,  preliminary  tests  of  experimental  effects  on  health  status 
and  health  behaviors,  reported  in  Chapters  6.0  and  7.0,  implemented  the  intent-to-treat 
model.  Tests  of  expenditure  and  utilization  effects,  reported  in  Chapter  5.0,  disaggregated 
the  experimental  group  into  users  and  non-users,  to  provide  evidence  on  the  selection 
issue.  The  final  cross-cutting  evaluation  report  of  this  demonstration  will  link  both 
experimental  status  and  use  of  services  to  all  the  major  health  and  utilization  outcomes  of 
the  evaluation. 

4.3  External  Validity:    The  Demonstration  as  a  Model  for  a  Medicare 

Benefit 

In  the  final  report  of  the  cross-cutting  evaluation,  HCFA  will  assess  the  cost- 
effectiveness  of  the  demonstration  intervention  and  the  likely  cost-effectiveness  of  a 
Medicare  prevention  benefit  At  that  time,  HCFA  will  consider  the  generalizability,  or 
external  validity,  of  findings  from  the  demonstration  on  the  Medicare  program.  This 
section  introduces  two  issues  that  the  final  report  will  address  in  greater  detail:  the 
implications  for  Federal  policy  of  testing  a  prevention  package  in  the  demonstration,  and 
the  representativeness  of  participants  attracted  to  the  demonstration. 

The  Preventive  Services  Package 
The  demonstration  will  provide  guidance  on  what  Congress  might  expect  in  terms  of 
utilization  and  outcomes  from  a  benefit  that  covers  a  prevention  package  of  clinical  and 
educational  services;  however,  demonstration  data  will  not  be  sufficient  to  describe  the 
effects  of  implementing  piecemeal  any  of  the  components  of  the  package.  Recent 
legislation  added  mammograms  to  the  list  of  covered  Part  B  services.  Proposed  legislation 
suggests  that  Congress  is  considering  coverage  for  both  bundled  and  unbundled  prevention 
services  (such  as  influenza  vaccinations).  The  demonstration  data  do  not  provide  sufficient 
statistical  power  to  evaluate  the  cost-effectiveness  of  specific  interventions  such  as 
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immunizations,  substance  abuse  counseling,  and  diet  and  exercise  programs.  Participants 
who  used  these  services  also,  in  most  cases,  used  other  preventive  services  as  well,  making 
it  impossible  to  disentangle  individual  effects.  Therefore,  the  findings  from  the 
demonstration  will  provide  useful  but  limited  guidance  on  the  appropriate  design  of  a 
Medicare  preventive  services  benefit  program. 

The  Representativeness -of  Demonstration  Enrol  lees 
Within  the  broad  eligibility  guidelines  determined  by  HCFA  and  the  projects,  HCFA 
did  not  require  uniformity  in  beneficiary  characteristics  across  the  projects.  Indeed,  some 
projects  did  not  attempt  to  represent  the  socioeconomic  characteristics  (race,  income, 
education)  of  their  areas. 

As  shown  in  Exhibit  4-4,  there  are  several  notable  differences  among  projects  in 
enrollee  socio-demographic  profiles,  suggesting  the  difficulty  in  drawing  generalized 
conclusions  about  the  effectiveness  of  prevention.5 

Average  age  is  highest  in  the  Johns  Hopkins  project,  where 
16-17  percent  of  enrollees  are  80  years  or  older, 

Minority  enrollment  is  limited;  participation  rates  exceed  10  percent 
only  in  the  Johns  Hopkins  and  UCLA  projects; 

In  all  five  projects,  women  outnumber  men  as  they  do  generally  in  the 
elderly  population; 

The  Johns  Hopkins  enrollees  are  less  likely  to  have  living  spouses  than 
enrollees  in  other  projects; 


Appendix  A  presents  detailed  data  on  socio-demographic  enrollee  characteristics  by  project 
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EXHIBIT  4-4 
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About  one-third  of  the  enrollees  in  Johns  Hopkins  and  UCLA  live 
alone;  a  slightly  lower  percentage  live  alone  in  the  other  sites; 


The  proportion  of  enrollees  living  in  a  special  residence  for  elderly  is 
highest  (about  5-6  percent)  in  the  Pittsburgh  project;  this  proportion  is 
slightly  lower  (3-4  percent)  in  the  West  coast  projects  (San  Diego, 
UCLA,  and  Washington); 

Enrollment  of  college-educated  participants  is  higher  in  the  West  Coast 
projects  (San  Diego,  UCLA,  Washington)  with  over  half  of  the 
enrollees  having  had  some  college  education,  compared  to  less  than 
20  percent  in  the  East  Coast  projects  (Johns  Hopkins  and  Pittsburgh). 

The  percentage  (slightly  over  80  percent)  of  enrollees  in  Pittsburgh  who 
report  being  completely  retired  is  higher  than  in  the  other  projects 
(generally  about  70  percent); 

Enrollment  of  low  income  beneficiaries  is  substantially  greater 
(33  percent)  in  Johns  Hopkins;  enrollment  of  high  income 
beneficiaries  is  substantially  greater  (20  percent)  in  UCLA. 

Enrollees'  usual  source  of  care  is  project-specific,  with  beneficiaries 
citing  their  usual  source  of  care  as  the  participating  HMO  in  the  two 
HMO  sites  (San  Diego  and  Washington);  the  majority  of  enrollees  in 
the  fee-for-service  sites  report  private  physicians  as  their  usual  source 
of  care. 

The  functional  status  of  enrollees  also  varies  among  the  demonstration  projects,  as 
shown  in  Exhibit  4-5.6  Overall,  by  certain  measures,  the  COBRA  enrollees  tend  to  be  in 
better  health  than  elderly  surveyed  in  other  studies  that  did  not  focus  on  prevention.  The 
percentage  of  enrollees  reporting  Activities  of  Daily  Living  (ADL)  or  Instrumental 
Activities  of  Daily  Living  (LADL)  dependency  is  relatively  low  in  both  Pittsburgh  and 


6Appendix  A  presents  detailed  data  on  earollee  functional  status  and  risk  factors  by  project 
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EXHIBIT  4-5 
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Washington.7  Less  than  9  percent  of  enrollees  in  Pittsburgh  and  Washington  reported 
themselves  to  be  dependent  in  one  or  more  ADLs  (bathing,  dressing,  and  transferring)  or 
dependent  in  one  or  more  IADLs  (shopping,  travel,  light  housework,  and  cooking).  While 
comparable  to  published  norms  for  the  community-based  elderly,  the  percentage  of 
enrollees  reporting  themselves  to  be  ADL  dependent  is  slightly  higher  (9.5  percent)  in 
Johns  Hopkins  than  other  projects.  Similarly,  the  percentage  reported  to  be  IADL 
dependent  is  slightly  higher  (12  percent- 14  percent)  in  UCLA  compared  to  enrollees  in 
other  projects.  Comparable  information  on  the  functional  status  of  San  Diego  enrollees 
was  unavailable. 

The  percentage  of  enrollees  reporting  themselves  as  having  some  degree  of  bladder 
incontinence  varies  substantially  among  projects,  ranging  from  17  percent  in  San  Diego  to 
practically  half  of  the  enrollees  in  Washington.8  This  variation  may  be  due,  in  part,  to  the 
wording  of  the  interview  questions  which  varied  by  project9 

Between  two-thirds  and  three-quarters  of  the  enrollees  claimed  to  have  had  at  least  one 
serious  health  condition  (heart  disease,  stroke,  diabetes,  cancer,  chronic  lung  disease,  or 
arthritis).  Johns  Hopkins  did  not  ask  its  respondents  about  these  conditions.  In  all 
projects  except  UCLA,  over  half  of  the  enrollees  reported  to  have  vision  and/or  hearing 
problems.  However,  only  a  quarter  of  the  enrollees  in  UCLA  claimed  to  have  such 
problems. 

There  is  also  wide  variation  in  the  percentage  of  participants  reporting  that  they  had  to 
cut  down  on  their  usual  activities  or  were  bedridden  due  to  illness  or  injury  in  the  year 


According  to  a  1982  survey  in  three  cities,  the  percentage  of  community-based  elderly  who  are  ADL 
dependent  ranges  from  10-20  percent.  Established  Populations  for  Epidemiologic  Studies  of  the  Elderly.  Resource 
Data  Book.  National  Institute  on  Aging,  NIH  Publication  No.  86-2443.  Another  study  reports  that  approximate  ty 
14  percent  of  the  elderly  claim  to  be  IADL  dependent  Proceedings  of  1988  International  Symposium  on  Data 
on  Aging.  Vital  and  Health  Statistics.  National  Center  for  Health  Statistics,  August  1991. 

Published  estimates  of  incontinence  range  from  32  to  50  percent.  Established  Populations  for  Epidemiologic 
Studies  of  the  Elderly.  Resource  Data  Book.  National  Institute  on  Aging,  NIH  Publication  No.  86-2443. 

9The  interview  questions  in  all  projects  except  San  Diego  were  rather  specific,  asking  whether  the  enrollees 
ever  experienced  any  leakage  (rather  than  whether  the  enrollee  had  ever  been  treated  for  incontinence,  as  in  San 
Diego). 
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before  the  demonstration.  About  a  quarter  of  the  participants  in  Johns  Hopkins  and 
Pittsburgh  claimed  to  have  had  at  least  1  day  on  which  they  had  to  cut  down  on  their  usual 
activities;  over  40  percent  of  the  participants  in  UCLA  experienced  such  disability  days. 
Less  than  4  percent  of  the  participants  in  Johns  Hopkins,  San  Diego  and  Washington 
reported  having  been  bedridden  due  to  illness  or  injury.  Considerably  more  participants 
in  UCLA  (47  percent)  and  Pittsburgh  (15-19  percent)  reported  having  such  bed  days  in  the 
year  before  the  demonstration,  reflecting  in  part  different  time  frames  for  recall  between 
the  projects. 

Risk  Factors 

Overall,  the  percentage  of  COBRA  participants  with  risk  behaviors  are  equal  to  or  less 
than  the  percentage  of  the  general  elderly  population.  For  example,  as  shown  in  Exhibit 

4-  5,  between  62  and  77  percent  of  COBRA  participants  in  San  Diego,  UCLA,  and 
Washington  reported  at  the  baseline  interview  that  they  drink  alcohol,  and  less  then 
10  percent  reported  that  they  smoke  cigarettes,  figures  that  are  comparable  to  the  general 
elderly  population.10  Less  than  half  of  the  enrollees  in  Pittsburgh  claimed  to  drink  alcohol 
at  baseline;  less  than  20  percent  of  the  enrollees  in  Pittsburgh  and  less  than  10  percent  in 
San  Diego  claimed  to  be  cigarette  smokers. 

The  percentage  of  COBRA  enrollees  who  experienced  at  least  one  hospitalization  in 
the  1  year  period  prior  to  the  demonstration  ranges  from  6  percent  to  19  percent  In 
addition,  the  average  length  of  stay  is  lower  in  the  two  managed  care  projects  (San  Diego 
and  Washington)  than  in  the  fee-for-service  projects  (Johns  Hopkins,  UCLA,  and 
Pittsburgh).  This  same  pattern  between  the  managed  care  and  fee-for-service  projects  is 
more  clearly  seen  when  examining  the  proportion  of  enrollees  with  two  or  more  hospital 
admissions.  Less  than  3  percent  of  enrollees  in  San  Diego  and  Washington  experienced 
at  least  two  hospital  admissions  in  the  year  prior  to  the  demonstration,  compared  to 

5-  6  percent  of  participants  in  the  Johns  Hopkins,  UCLA,  and  Pittsburgh  projects. 


106etween  40-70  percent  of  the  elderly  in  three  cities  drink  alcohol;  and  between  8-20  percent  are  smokers. 
Established  Populations  for  Epidemiologic  Studies  of  the  Elderly.  Resource  Data  Book.  National  Institute  on 
Aging,  NIH  Publication  No.  86-2443. 
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In  the  U.S.  as  a  whole,  Medicare  beneficiaries  were  hospitalized  at  a  rate  of  33,000  per 
100,000  in  1989  and  1990.  Pre-demonstration  hospitalization  rates  among  demonstration 
controls  varied  from  7,000  per  100,000  in  San  Diego  to  26,000  per  100,000  in  Johns 
Hopkins'  Baltimore  target  area.  During  the  year  after  baseline  data  collection,  death  rates 
within  the  demonstration  averaged  2,556  per  100,000  and  ranged  from  an  estimated 
911  per  100,000  in  Washington  to  4,910  per  100,000  in  Johns  Hopkins:  among  all  Medicare 
beneficiaries,  the  1989  death  rate  was  4,700  per  100,000.u 

The  relatively  good  health  of  demonstration  enrollees  poses  three  challenges  to  the 
evaluation: 

Effects  of  preventive  services  may  require  considerable  time  to  materialize.  The 

addition  of  two  demonstration  years  will  help  alleviate  this  concern. 

Findings  from  the  evaluation  may  not  apply  in  less  healthy  populations.  Of 
course,  if  the  young  and/or  healthy  elderly  prove  to  be  the  only  users  of  a 
Medicare  prevention  benefit,  this  concern  may  not  have  practical  significance. 
However,  the  beneficial  effects  of  prevention  in  less  healthy  elderly  individuals 
may  exceed  the  effects  observed  in  the  demonstration.  Therefore,  it  may  be  in 
the  government's  interest  to  create  special  incentives  for  these  individuals  to  use 
preventive  services.  To  test  the  effectiveness  of  preventive  services  among  less 
healthy  beneficiaries,  HCFA  will  conduct  sub-analyses  of  outcomes  among 
demonstration  enrollees  whose  age  and  health  status  more  nearly  resembles  the 
"average"  Medicare  beneficiary. 

If  the  potential  users  of  a  prevention  benefit  are  generally  healthy,  a  Medicare 
benefit  may  pay  for  screening  and  information  that  benefit  users  would  have 
sought  (and  paid  for,  where  necessary)  on  their  own.  Under  these  conditions, 
the  principal  effect  of  a  benefit  might  be  to  shift  the  costs  of  prevention  from 
the  private  to  the  public  sector,  not  to  increase  the  total  use  of  preventive 
services  by  elderly  beneficiaries.12 


Hospitalization  and  death  rate  data  were  calculated  from  Medicare  claims  and  eligibility  files. 

12For  example,  a  recently-submitted  report  on  the  Medicare  Influenza  Vaccine  Demonstration  estimates  the 
influenza  vaccination  rate  among  elderly  beneficiaries  without  the  benefit  to  be  30  percent;  with  a  benefit  that 
covers  influenza  vaccinations,  and  a  hypothetical  provider  reimbursement  rate  of  $4,  a  complete  shift  of  the  costs 
of  vaccinating  these  beneficiaries  would  add  $37.2  million  without  any  new  offsetting  reductions  in  Medicare 
expenditures  for  the  treatment  of  influenza-related  illnesses. 
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The  ideal  data  for  assessing  the  potential  for  cost  shifting  under  a  prevention  benefit 
would  include  evidence  on  the  numbers  and  characteristics  of  Medicare  beneficiaries  who 
pay  for  preventive  health  care  without  the  benefit,  and  how  much  they  spend  for  prevention 
on  average.  These  data  are  not  available  from  Medicare  claims.  Although  insufficient  by 
themselves,  baseline  data  collected  by  the  COBRA  demonstration  on  prior  health  and 
health  service  utilization,  as  well  as  subjects'  attitudes  toward  good  health  practices  and 
risk-related  behavior,  should  provide  clues  about  the  cost-shifting  potential  of  a  prevention 
benefit.  However,  the  volume  and  detail  of  these  demonstration  data  vary. 

For  example,  items  from  Johns  Hopkins'  baseline  questionnaire  will  show  what 
percentage  of  subjects  report  having  been  screened  in  the  past  (Pap  smear,  mammogram). 
Other  projects  collected  less  detailed  information  regarding  prior  use  of  preventive  services, 
concentrating  instead  on  recalled  acute  episodes.  Unfortunately,  none  of  the  COBRA  data 
include  self-reported  pre-demonstration  expenditures  for  preventive  health  services. 

For  the  final  report,  findings  from  the  demonstration  will  be  combined  with  findings 
from  the  research  literature  to  infer,  within  a  reasonable  range,  the  current  frequency  of 
preventive  service  utilization  among  Medicare  beneficiaries.  Assuming  that  Medicare  now 
captures  most  of  any  savings  due  to  preventive  services  (reduced  hospitalizations  and  other 
Medicare-reimbursed  health  care)  without  paying  the  cost,  adding  a  prevention  benefit 
would  be  cost-effective  for  Medicare  only  if  there  were  a  net  increase  in  the  use  of 
preventive  services  by  the  elderly  sufficient  to  offset  the  total  amount  of  prevention  costs 
shifted  to  Medicare  from  other  sources  as  well  as  the  costs  of  paying  for  prevention  among 
new  users. 
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5.0 


SERVICES  PROVISION  UNDER  THE  DEMONSTRATION 


5.1 


Overview 


Disease  prevention  and  health  promotion  services  must  avert  some  preventable  sickness 
or  death  to  be  cost-effective.  This  chapter  reviews  preliminary  evidence  from  the 
demonstration  on  the  contribution  of  preventive  services  to  reductions  in  Medicare- 
reimbursed  health  care  services.  Conclusions  on  cost-effectiveness  will  be  included  in  the 
final  Report  to  Congress. 

Two  central  research  questions  are  addressed  in  this  chapter.  First,  did  those  elderly 
beneficiaries  who  were  offered  preventive  services  through  the  demonstration  use  them? 
The  five  COBRA  projects  have  successfully  recruited  elderly  Medicare  beneficiaries  into 
the  prevention  demonstration.  Once  in,  however,  how  many  in  the  experimental  group 
actually  followed  up  on  referrals,  visited  physicians  for  screens  and  tests,  and  attended 
counseling  sessions  and  classes?  This  chapter  reports  on  preventive  services  utilization  by 
experimental  group  members  during  the  first  year  of  waivered  services  provision. 

Second,  was  the  availability  and  use  of  preventive  services  through  the  demonstration 
associated  with  any  effects  on  hospitalization  rates,  utilization  of  non-hospital  services,  and 
Medicare  expenditures?  For  the  fee-for-service  projects  (Johns  Hopkins,  UCLA,  and 
Pittsburgh),  Medicare  claims  data  provided  information  on  utilization  and  expenditures  for 
hospital,  nursing  facility,  and  home  health  care.  For  the  managed-care  projects 
(Washington  and  San  Diego),  the  internal  data  systems  of  cooperating  managed  care 
programs  provided  information  on  hospital  utilization. 

5.2  Data  Sources 

Analyses  of  demonstration  effects  on  utilization  and  expenditure  drew  on  data  from 
several  sources: 


Medicare  waivered  services  claims  flies:  During  the  first  year  of  the 
demonstration,  Medicare  paid  $1.2  million  in  claims  for  health  risk  assessments, 
clinical  screens  and  health  promotion  services.  Estimates  of  expenditure  are 
based  on  claims  data  supplied  by  HCFA. 
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Medicare  demonstration  waivered  services  utilization  data:  The  COBRA 
projects  provided  data  from  visit  encounter  forms  describing  the  numbers,  dates 
of  service,  and  types  of  waivered  services  used  by  experimental  group  members. 
Each  project  offered  a  different  package,  defined  by  visits  (the  maximum 
number  of  encounters  with  participating  health  professionals)  and  services  (the 
separate  interventions  --  screens,  substance  abuse  counseling,  diet  workshops, 
depression  counseling  and  others)  that  might  be  provided  in  one  or  more  visits. 
For  the  analyses  reported  in  this  chapter,  only  three  variables  common  to  all 
projects  were  defined  for  waivered  services  utilization;  an  indicator  that  a 
beneficiary  received  one  or  more  waivered  services  (or  visits)  within  a  year  after 
the  baseline  interview,  and  two  indicators,  that  the  beneficiary  did  or  did  not 
use  the  maximum  number  of  visits,  or  services,  available. 

MDS  file  variables:  Certain  demographic  and  socioeconomic  indicators  from 
the  MDS  were  used  in  the  expenditure  and  utilization  analyses:  age,  gender, 
race,  education,  income,  living  arrangement,  marital  status,  smoker  (yes/no), 
retirement  status,  numbers  of  bed  days  in  the  pre-demonstration  period.  Values 
of  these  indicators  are  taken  from  the  baseline  surveys  conducted  by  all  the 
COBRA  projects. 

Utilization  and  expenditure  data:  Managed-care  programs  that  participate  in 
Medicare  are  not  required  to  submit  claims  to  Medicare  for  services  provided 
to  enrolled  beneficiaries.  Therefore,  Medicare  Part  A  claims  files  were  used  to 
construct  measures  of  utilization  and  expenditure  only  for  demonstration 
participants  in  the  COBRA  fee-for-service  projects.  The  two  managed  care 
programs  provided  hospital  utilization  measures;  it  was  decided  that  cost 
information  maintained  by  these  programs  could  not  be  compared  to  charge 
and  reimbursement  data  from  the  regular  Medicare  claims.  Therefore,  no 
estimates  of  the  dollar  value  of  non-preventive  services  used  by  managed  care 
participants  were  computed.13  Participants  were  checked  against  Medicare 
eligibility  files,  to  validate  eligibility,  to  extract  certain  data  elements,  such  as 
age  and  gender,  used  to  verify  MDS  data,  and  to  determine  which  fee-for- 
service  participants  participated  in  group  health  programs  during  the  year 
before  (the  "Pre-Demonstration  Year")  and  after  intake  ("Year  1").  14  These 
two  annual  periods  are  specific  to  each  individual  participant  and  are  defined 
as  365  days  before  and  after  the  beneficiary  consented  to  participate  in  the 
demonstration. 


l3Medicare  expenditures  for  beneficiaries  enrolled  in  a  managed  care  plan  cover  monthly  capitation  payments, 
and  are  therefore  not  reflective  of  actual  health  care  utilization  patterns. 

14ln  the  UCLA  files,  the  health  insurance  claim  numbers  for  28  beneficiaries  were  determined  to  be  wrong, 
comparing  age,  gender,  and  name  against  Medicare  eligibility  files.  These  individuals  are  not  included  in  any  of 
the  analyses  reported  in  this  chapter. 
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Medicare  claims  and  eligibility  data:  Medicare  Part  A  claims,  from  the  Medicare 
Automated  Data  Retrieval  System  (MADRS)  were  used  to  construct  utilization  and 
expenditure  measures  for  the  COBRA  fee-for-service  projects.  MADRS  includes  annual 
summary  records  of  Part  B  physician  expenditures,  but  service  dates  are  not  available. 
Because  Part  B  data  could  not  be  allocated  to  periods  before  and  after  demonstration 
intake,  Part  B  utilization  and  expenditure  data  are  not  reported  for  demonstration 
participants.15 

The  following  measures  were  estimated  for  each  experimental  and  control  group 
member  for  the  year  before  and  the  year  after  the  demonstration  began: 

Total  Part  A  charges  and  reimbursements 

Total  Part  A  charges  and  reimbursements  per  day  alive 

Total  hospital  charges  and  reimbursements,  admissions,  lengths  of  stay 

Total  nursing  facility  charges  and  reimbursements,  admissions,  lengths  of  stay 

Total  home  health  agency  charges,  reimbursements,  and  visits. 

Estimates  of  each  utilization  and  expenditure  variable  were  computed  for  the  users  of 
each  service.  The  probabilities  of  service  utilization  are  also  computed.  In  addition, 
Medicare  claims  were  used  to  compute  two  measures  of  beneficiary  risk  status  at  entry  into 
the  demonstration:  two  or  more  hospitalizations  during  the  year  before  the  demonstration; 
one  or  more  hospitalizations  for  at  least  one  of  the  following  conditions  -  malignant 
cancer,  heart  condition/stroke,  essential  hypertension,  chronic  obstructive  pulmonary 
disease. 

Managed  care  internal  files:  GHC  (Washington)  and  Secure  Horizons  (San  Diego) 
provided  within-plan  utilization  data  for  demonstration  participants.  Only  hospital 
admissions  were  dated;   annual  summaries  were  provided  for  nursing  home  and  home 


The  fee-for-service  projects  planned  to  acquire  detailed  Medicare  Part  B  history  data  from  their  carriers, 
in  order  to  allocate  physician  and  other  Part  B  services  to  the  appropriate  time  periods.  At  the  time  this  report 
was  prepared,  none  of  the  projects  had  attempted  to  analyze  these  data. 
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health  utilization.  Because  the  analysis  called  for  measures  of  utilization  in  the  365-day 
period  after  the  beneficiary  consented  to  participate,  only  hospital  utilization  could  be 
allocated  accurately  to  the  study  period.  Therefore,  the  only  measures  of  non-preventive 
services  utilization  for  managed-care  participants  are  numbers  and  lengths  of  hospital  stays, 
in  the  year  before  and  after  intake.  Utilization-based  risk  variables  for  the  pre- 
demonstration  period  (two  or  more  hospital  admissions,  hospitalization  for  particular 
conditions)  were  also  computed  for- the  managed  care  participants.  In  the  final  report,  an 
attempt  will  be  made  to  include  ambulatory  care  utilization  data  for  managed  care 
participants. 

5.3  Participant  Utilization  of  Demonstration  Services 

Recruitment  and  assignment  to  experimental  group  status  did  not  ensure  use  of  the 
intervention  services.16  This  section  discusses  the  characteristics  of  the  experimental 
enrollees  who  received  services  and  the  type  of  services  used. 

5.3.1        Characteristics  of  Experimental  Participants  Receiving  Services 

As  shown  in  Exhibit  5-1,  a  majority  of  experimental  enrollees  utilized  at  least  one  type 
of  intervention  service.  Across  all  projects,  close  to  80  percent  of  the  experimental 
received  intervention  services.  The  percentage  was  lowest  in  Johns  Hopkins  where 
59  percent  received  a  preventive  or  counseling  visit  This  low  percentage  may  be  due  to  the 
fact  that  Johns  Hopkins  participants  were  responsible  for  scheduling  their  own  preventive 
and  counseling  visits;  whereas,  in  most  other  projects,  visit  appointments  were 


16Intervention  services  excludes  the  administration  of  the  HRA,  a  warvered  demonstration  service  in  all 
projects. 
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EXHIBIT  5  1 

COBRA  Medicare  Prevention  Demonstration  Evaluation 
Utilization  of  Intervention  Services  within  First  Year 


Johns 

All  Sites  Hopkins  Pittsburgh  UCLA  San  Diego  Washington 
(n  =  7915)      (n  =  21  If)      (n  »  2«5S)      (n  ■  973)       (n  «  899)       (n  =  1270) 


Received  No  Intervention  Services  20.8%  40.9%  10.5%  28.2%  3.7%  14.9% 

Received  Intervention  Services  79.2%  59.0%  89.5%  71.8%  96.3%  85.1% 


LI 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set. 


pre-scheduled  by  the  providers.17  Of  special  note,  almost  all  (96  percent)  experimental 
in  San  Diego  received  a  clinical  screening  or  attended  one  of  the  eight  health  promotion 
workshops. 

The  characteristics  of  the  experimental  who  received  services  generally  reflect  the 
characteristics  of  the  entire  sample  of  enrollees.  For  example,  the  majority  of 
demonstration  enrollees  were  under  80  years  of  age,  married,  were  not  of  an  ethnic 
minority,  did  not  live  alone,  and  were  completely  retired  (see  Exhibit  5-2).  Similarly,  the 
majority  of  enrollees  were  functionally  independent  (ADL,  IADL,  and  bladder  continence) 
and  experimentals  with  these  characteristics  were  also  more  likely  to  have  received 
intervention  services. 

On  the  other  hand,  certain  characteristics  were  clearly  associated  with  receipt  of 
intervention  services.  In  particular,  while  there  were  more  women  than  men  participating 
in  the  demonstration  overall,  women  were  less  likely  to  receive  intervention  services 
(58  percent  of  service  users  were  women  compared  to  64  percent  of  non-users).  College- 
educated  enrollees  were  more  likely  than  less-educated  enrollees  to  have  received 
intervention  services.18  With  the  exception  of  UCLA,  most  participants  reported  having 
a  vision  or  hearing  problem;  however,  participants  with  either  of  these  two  problems  were 
less  likely  to  receive  services  as  well.  Less  than  one-half  of  the  enrollees  reported 
themselves  to  be  in  good  health;  enrollees  perceiving  themselves  to  be  in  good  health  were 
more  likely  to  receive  services. 


17Experimental  enrollees  assigned  to  the  provider  group  in  Pittsburgh  were  also  responsible  for  scheduling 
their  own  appointments  for  intervention  services.  However,  the  Pittsburgh  staff  encouraged  providers  to  perform 
outreach  to  those  experimentals  eligible  for  interventions.  As  a  result,  about  90  percent  of  both  experimental 
groups  in  Pittsburgh  received  intervention  services. 

l8Appendix  B  presents  the  characteristics  of  experimental  participants  who  received  intervention  services  for 
each  project. 
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EXHIBIT  5-2 

COBRA  Medicare  Prevention  Demonstration  Evaluation 

Characteristics  of  Experimental*  by  Receipt  and  Non-Receipt  of  Intervention  Sen 

Across  All  Sites 


ices 


Socio-Demographic 
Female 
Over  80  Vrs 
White 
Married 
Lives  Alone 

Lives  in  Special  Residence  for  Elderly 
Some  College  Education 
Completely  Retired 
Highest  Income 
Functional  Status 

Dependent  in  1  or  More  ADLs 
Dependent  in  1  or  More  lADLs 
Incontinent 

1  or  More  Health  Conditions 

Vision  or  Hearing  Problem 

1  or  More  Disability  Days 

I  or  More  Bed  Days 
Risk  Factors 
Drinker 
Smoker 

In  Good  Health 


Did  Not  Receive 
Sen-ices 


63.5% 
15.0% 
90.4% 
50.9% 
32.8% 

3.5% 
23.2% 
69.8% 

4.9% 

9.9% 
7  8% 
36.7% 
76.0% 
44.2% 
31.3% 
14.0% 

58.9% 
14.1% 
41.9% 


Received  Services 

58.1%" 
6.5%*" 
95.1%" 
62.4%" 
29.6%" 
3.2% 
33.3%" 
74.4%" 
5.1% 

4.5%" 
7.8%" 
33.5%  + 
74.6% 
41.3%" 
29.9% 
1 1 .856  * 

59.3% 
10.6%" 
42.5% 


Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Dan  Set 

Note:  Percentages  are  based  on  observations  without  missing  values. 

+  Differences  between  treatment  groups  are  significant  at  the  0.10  level. 
•   Differences  berueen  treatment  groups  are  significant  at  the  .05  level 
Differences  betueen  treatment  groups  are  significant  at  the  .01  level. 
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5.3.2        Type  of  Intervention  Services  Used 

As  described  earlier  in  Chapter  4.0,  all  projects  offered  clinical  screening  and  health 
promotion  services.  With  the  exception  of  Washington,  the  clinical  screening  component 
was  the  first  service  offered,  followed  by  counseling  or  health  promotion  services.  As 
shown  in  Exhibit  5-3,  few  participants  received  only  counseling  services.  Ninety  percent 
or  more  of  the  participants  in  the  two  managed  care  projects  (San  Diego  and  Washington), 
as  well  as  in  UCLA  (where  services  were  also  provided  on  a  centralized  basis)  received 
both  clinical  screening  and  health  promotion  services. 

In  contrast,  most  participants  in  Johns  Hopkins  and  Pittsburgh  received  only  clinical 
screening  services.  The  majority  (57  percent)  of  the  participants  in  Johns  Hopkins  received 
only  the  first  preventive  clinical  screening  visit  and  did  not  pursue  any  followup  counseling 
visits.  Similarly,  over  three  quarters  of  the  participants  in  the  Pittsburgh  project  received 
only  clinical  screening  services. 

Another  measure  captures  participants'  use  of  the  maximum  number  of  visits  available 
under  the  demonstration.  The  numbers  of  visits  vary  among  the  projects 
(see  Exhibit  5-3): 

Johns  Hopkins  participants  were  eligible  to  receive  a  total  of  four  visits 
(two  preventive  and  two  counseling  visits).  Among  those  who  received 
services,  participants  scheduled,  on  average,  1.4  visits,  representing  less 
than  half  of  the  maximum  number  of  visits  available. 

San  Diego  participants  were  eligible  to  receive  a  clinical  screening  visit 
and  attend  eight  health  promotion  workshops.  On  average,  participants 
in  San  Diego  attended  6.3  of  these  visits/workshops,  representing  about 
70  percent  of  the  maximum  number  of  visits  available. 

The  intervention  in  UCLA  was  provided  centrally  during  a  1-day 
Screening  and  Health  Promotion  Clinic.  As  a  result,  all  participants 
receiving  intervention  services  received  the  maximum  one  visit 

Nine  different  types  of  intervention  services,  recommended  on  the  basis 
of  evidence  from  screenings,  were  available  to  participants  in 
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EXHIBIT  5-3 


COBRA  Medicare  Prevention  Demonstration  Evaluation 


Type  of  Intervention  Services  Received 


Intervention  Servtcea 


Type  of  Service 

Clinical  Only 
Counseling  Only 
Clinical  and  Counseling 

Visits 

Maximum  Number  of  Visits 
Average  Number  of  Visits 
Average  Number  of  Visits  with  a 
Physician 


All  Sites 
(n  =  (272) 


Johns  Hopkin 
(n  =  1250) 


Pittsburgh 

(n  =  2376) 


UCLA 
(n  =  699) 


44.8% 


55.2% 


2.8 
I.I 


57.4% 
1.0% 
41.7% 


4.0 
1.4 
1.4 


78.6% 
0.0% 
21.4% 


40.0 
2.7 
II 


1.6% 
1.0% 
97.9% 


1.0 
1.0 
0 


San  Diego 
(n  =  866) 


10.2% 
1.0% 
89.3% 


9.0 
6.3 
1.0 


Washington 
(n  =  1081) 


9.5% 
0.0% 
90.5% 


3.0 
2.8 
0.9 


Place  of  Service 


Physician  Office 

35.9% 

99.0% 

42.7% 

0.0% 

0.0% 

0.0% 

Hospital 

18.8% 

0.9% 

49.3% 

0.0% 

0.0% 

0.0% 

HMO/Clinic 

29.8% 

0.0% 

0.0% 

100.0% 

10.2% 

100.0% 

Other 

0.1% 

0.0% 

0.0% 

0.0% 

0.6% 

00% 

Combination 

15.3% 

0.1% 

7.9% 

0.0% 

89.3% 

00% 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  (MDS). 
*  Less  than  I  percent. 


Pittsburgh,  each  of  which  included  one  or  more  visits.19  As  a  result,  a  participant 
receiving  the  full  range  of  intervention  services  would  have  attended  39  visits.  However, 
the  average  number  of  visits  among  Pittsburgh  participants  was  close  to  three,  in  part  due 
to  the  fact  that  less  than  a  quarter  of  the  Pittsburgh  participants  received  both  clinical  and 
health  promotion  visits. 

Washington  participants  could  have  been  scheduled  for  four  types  of 
visits:  a  health  promotion  visit  with  a  nurse;  two  disease  prevention 
visits,  one  with  a  nurse  and  the  other  with  a  physician;  and  one  or  more 
classes.  In  fact,  participants  attended,  on  average,  2.8  visits. 

Use  of  physicians  to  deliver  demonstration  services  varied  among  the  projects.  All  visits 
in  Johns  Hopkins  were  reported  to  be  with  physicians;  however,  only  one  of  the 
intervention  services  was  conducted  by  a  physician  in  the  remaining  four  projects.20  As 
a  result,  as  shown  in  Exhibit  5-3,  participants  were  seen  by  a  physician,  on  average,  only 
once  during  the  first  year  of  the  intervention. 

The  location  of  preventive  service  visits  was  also  project-specific  (see  Exhibit  5-3)  and 
was  associated  with  the  design  of  the  intervention  package.  For  example,  many  services 
were  provided  at  HMO  facilities  in  the  two  managed  care  projects.  All  health  promotion 
and  disease  prevention  visits  in  Washington  were  provided  at  the  GHC  HMO  clinics. 
While  all  clinical  screening  visits  were  performed  at  the  Sharp  Rees-Stealy  Group  Practice 
facilities  in  San  Diego,  the  eight  health  promotion  workshops  were  held  in  the  community 
in  a  variety  of  settings  (e.g.,  senior  centers,  community  halls,  etc.).  Close  to  90  percent  of 
the  San  Diego  experimental  participants  received  intervention  services  at  both  the  HMO 
and  in  these  community  settings. 


19The  Pittsburgh  intervention  included  the  following  types  of  services:  nutrition  (5  visits);  weight  control  ( 16 
visits);  diabetes  mellitus  (1  visit);  dementia/depression  evaluation  (2  visits);  smoking  cessation  (8  visits);  alcohol 
counseling  (5  visits);  influenza  immunization  (1  visit/year);  clinical  screening  (1  visit). 

^e  clinical  screening  was  conducted  by  a  physician  in  San  Diego  and  Pittsburgh.  The  dental  screen  was 
performed  by  a  dentist  in  UCLA;  one  of  the  two  disease  prevention  visits  was  conducted  by  a  physician  in 
Washington. 
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There  was  variation  in  the  place  of  service  among  the  three  fee-for-service  sites.  As 
mentioned  above,  UCLA  held  a  one-day  Screening  and  Health  Promotion  Clinic  on  the 
UCLA  campus  during  which  participants  received  intervention  services.  Almost  all 
(99  percent)  of  the  intervention  services  were  provided  in  physicians  offices  in  Johns 
Hopkins.  The  Pittsburgh  design  required  that  the  clinical  screening  be  performed  by  the 
provider  group  (physician  or  hospital)  to  which  the  participant  was  randomized.21 
Participants  in  the  physician-based  experimental  group  could  receive  health  promotion 
services  from  the  physician  or  be  referred  to  a  local  participating  hospital  for  these  services. 
As  shown  in  Exhibit  5-3,  almost  half  of  the  participants  in  Pittsburgh  received  intervention 
services  from  participating  hospitals;  another  40  percent  received  services  solely  from 
physicians. 

The  above  discussion  highlights  the  general  types  of  intervention  services  (e.g.,  clinical 

vs.  counseling)  received  by  participants.  However,  it  is  also  interesting  to  identify  the  more 

"popular"  types  of  intervention  services  received  by  participants.  As  shown  in  Exhibit  5-4, 

these  intervention  services  were  project-specific: 

Almost  all  (99  percent)  participants  in  Johns  Hopkins  scheduled  and 
attended  prevention  visits. 

Almost  all  (99  percent)  participants  in  San  Diego  received  the  clinical 
screening.  In  addition,  between  60  and  80  percent  of  participants 
attended  each  of  the  eight  health  promotion  workshops  held  in  the 
community. 

Ninety-five  percent  of  the  participants  in  UCLA  received  the  clinical 
screening  at  the  Screening  and  Health  Promotion  Clinic.  In  addition, 
almost  all  participants  (97  percent)  were  screened  for  dental  health, 
gait  and  balance,  and  hearing,  as  well  as  attended  a  mini-workshop  on 
lifestyle  and  social  relations,  diet  and  nutrition,  dental  health,  exercise 
and  fitness,  home  safety,  and  smoking  cessation. 

Almost  all  (99  percent)  participants  in  Pittsburgh  received  the  clinical 
screening.  However,  with  the  exception  of  the  influenza  immunization 
in  the  first  year,  participation  in  the  other  eight  interventions  was  low 


21  Recall  that  Pittsburgh  bad  two  types  of  experimental  groups:  1)  participants  assigned  to  physicians  and  2) 
participants  assigned  to  hospitals. 
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JOHNS  HOPKINS 


Prevention  Visits  (99%) 
Counseling  Visits  (43%) 


EXHIBIT  5-4 

COBRA  Medicare  Prevention  Demonstration  Evaluation 
Utilization  of  Project-Specific  Intervention  Services* 


PITTSBURGH* 


Screening  (99%) 

Nutrition  (10%) 
Weight  (9%) 
Diabetes  (3%) 
Depression  (2%) 
Smoking  (2%) 
Alcohol  (1%) 
Influenza 

immunizations  (57%) 


UCLA 


SAN  DIEGO 


WASHINGTON 


Oral  Examination  and 
Cancer  Screening  (98%) 

Gait  (98%) 

Hearing  Screen  (98%) 

Counseling  (97%) 

Clinical  Screen  (95%) 

Physical  Therapy/ 
Occupational  Therapy  (53%)b 

Social  Work  (43%)b 


rce:  COBRTTTedTTreTreven7!onT5e^^  Minimum  Data  Set  (MDS). 


Clinical  Screening  (99%) 
Memory  Workshop  (81%) 


Exercise  (88%) 


Breast  Screening  (87%) 
Nutrition  (87%) 
Planning  Ahead  (74%) 
Hypertension  (70%) 
Medications  (70%) 
Home  Safety  (69%) 
Minor  Ailments  Workshop  (63%)  Hearing  (57%) 


Mental  Alertness  Workshop 
(70%) 

Loss  of  Life  Workshop  (67%) 

Wellness  Workshop  (65%) 

Choices  for  Living  Workshop 
(64%) 


Selfcare/Relaxat  ion/Nutrition/ 
Exercise  Workshop  (61%) 

Footcara/Sunscreen/W  alking 
Workshop  (60%) 


Vision  (47%) 
Sleep  Problems  (36%) 
Incontinence  (20%) 
Seatbek  Use  (19%) 
Stress  (19%) 
Alcohol  (15%) 
Depression  (15%) 
Smoking  (9%) 


"Percentages  are  based  on  the  number  of  participants  receiving  intervention  services. 
b Based  on  need  identified  in  pre  screening 

C.1e,1enUg!?  °f  ,hoaC  *creened  "Ml  determined  eligible  for  each  intervention  were:  nutrition  (45%).  weight  (41  %).  diabetes  (26%).  depression  (36%).  smoking  (17%).  alcohol 


(10  percent  or  less  of  the  participants).  Slightly  over  half  (57  percent)  of  the 
participants  received  an  influenza  immunization  in  the  first  year. 

While  most  participants  attended  all  four  visits  in  Washington,  there 
was  a  wide  range  of  topics  which  were  addressed  in  these  visits.  Close 
to  90  percent  of  the  participants  discussed  the  importance  of  breast 
cancer  screening  (women  only),  exercise,  and  nutrition.  Other  topics 
of  key  interest  included  home  safety,  hypertension,  medication  use,  and 
planning  for  the  future. 

5.4  Net  Total  Medicare  Expenditures  During  the  First  Year 

HCFA  expended  approximately  $1.2  million  in  providing  HRAs  and  screening  and 
health  promotion  services  in  the  first  year  of  the  demonstration  (see  Exhibit  5-5).  The 
Pittsburgh  project  incurred  the  highest  expenditures  ($380,000),  in  part  due  to  their  large 
number  of  experimental  participants. 

Average  expenditures  on  prevention  services  per  experimental  by  each  project  reflect 
the  number  of  experimentals  enrolled,  utilization  rates  for  intervention  services  and 
reimbursement  rates.  As  shown  on  Exhibit  5-5,  expenditures  for  intervention  services  per 
experimental  beneficiary  across  all  projects  during  the  first  year  averaged  $116. 
Johns  Hopkins  had  the  lowest  average  expenditure  per  beneficiary,  about  $96,  primarily 
reflecting  a  relatively  low  rate  of  utilization  of  intervention  services  among  experimental 
enrollees.  Pittsburgh,  with  the  largest  experimental  enrollment,  also  had  a  low  average 
expenditure  per  beneficiary  (roughly  $100).  UCLA,  and  San  Diego  on  the  other  hand,  with 
relatively  small  experimental  groups,  had  above-average  expenditures  per  beneficiary. 

Across  all  projects,  total  expenditures  on  intervention  services  accounted  for  three 
quarters  of  the  total  expenditures.  However,  the  proportion  allocated  to  intervention 
services  varied  among  projects,  ranging  from  87  percent  in  Washington  to  63  percent  in 
UCLA. 


60 


EXHIBIT  5-5 


COBRA  Medicare  Prevention  Demonstration  Evaluation 
First  Year  Aggregate  Expenditures  for  Waivered  Services 


All  Sites        Johns  Hopkins      Pittsburgh        UCLA        San  Diego  Washington 


HRAs* 

Total  Expenditures  $31 1,156 
Screening  and  Health  Promotion 

Total  Expenditures*  $91 1 ,489 

Expenditures/Beneficiary0  $116.17 
All  Waivered  Services 

Total  Expenditures  $1,222,646 

Percent  of  Expenditures  Representing 

Intervention  Services  75% 


$37,602         $115,301  $85,650 


$47,580 


$25,023 


$200,242         $264,731      $146,574         $133,026  $166,916 
$95.86  $99.94       $154.61  $148.30  $132.16 

$237,844         $380,032     $232,224         $180,606  $191,939 


84% 


70% 


63% 


74% 


87% 


Source:  COBRA  Medicare  Prevention  Demonstration  Waivered  Services  Claims  file. 

*  HRAs  were  reimbursed  for  experimental  participants  in  all  projects  and  for  control  participants  in  the  following  three  projects:  San  Diego,  UCLA,  and 

University  of  Pittsburgh. 
b  Includes  experimentals  only. 

c  Based  on  all  experimental  beneficiaries,  regardless  of  receipt  of  intervention  services. 


5-5  Effects  of  the  Prevention  Intervention  on  Medicare  Expenditure  and 

Utilization 

Although  preventive  interventions  may  eventually  reduce  Medicare  expenditures  for 
acute  care,  such  reductions  were  not  expected  during  Year  1  of  the  demonstration.  Among 
experimental  group  participants,  roughly  20  percent  did  not  follow  up  with  visits  to 
physicians  and  other  health  professionals  for  disease  prevention  or  health  promotion 
services.  Changes  in  risk  behavior  and  attitudes  among  these  non-users  cannot  be  ruled 
out,  but  no  significant  changes  in  health  status  or  utilization  of  acute  care  services  due  only 
to  being  included  in  the  experimental  group  should  be  expected.  Of  those  who  did  follow 
up,  certain  immediate  effects  might  be  predicted.  Some  individuals  might  have  uncovered 
previously  undetected  conditions  through  clinical  screening;  a  fraction  of  these  might  have 
been  hospitalized  as  a  result.  Some,  exposed  to  education  on  healthy  lifestyles  through 
workshops  and  counseling  sessions  or  lectured  during  physician  visits  on  health  risk 
reduction  techniques,  might  have  taken  actions  that  will  have  beneficial  long-term  effects 
on  their  health  with  little  or  no  immediate  reduction  in  risks  of  hospitalization.  A  fraction 
might  have  reduced  immediate  risks  by  changing  their  behavior;  for  some, 
smoking  cessation  may  mean  immediate  reductions  in  hospitalizations  for  respiratory 
conditions. 

In  general,  the  use  of  preventive  services  is  expected  to  be  associated  with  no  change 
or,  at  most,  a  slight  increase  in  the  hospitalizations  and  hospital  expenditures  among 
experimental  relative  to  controls  in  Year  1. 

The  following  specific  hypotheses  are  also  tested: 

1.  Relative  changes  in  hospital  utilization  will  be  smaller  in  the  managed  care 
projects  than  in  the  fee-for-service  projects.  Managed  care  programs  have  purported  to 
control  expensive,  institutional  acute  care  utilization  by  encouraging  the  use  of  ambulatory 
care,  including  primary  disease  prevention  services  and  targeted  health  education 
workshops.  Even  though  Medicare  may  not  have  covered  preventive  services  in 
participating  HMOs  before  the  demonstration,  elderly  enrollees  in  most  managed  care 
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plans  probably  had  more  access  to  these  services  than  the  average  Medicare  beneficiary 
served  by  fee-for-service  providers.  If  so,  the  frequency  of  undetected  medical  conditions 
among  managed  care  enrollees  before  the  demonstration  should  have  been  relatively  low, 
meaning  few  hospitalizations  associated  with  newly-detected  conditions  compared  to  fee- 
for-service  beneficiaries. 

2.  Experimental  group  members  with  no  pre-demonstration  hospitalizations  will 
experience  above-average  increases  in  hospital  utilization  during  Year  1  (relative  to 
controls),  because  experimental  with  no  hospital  admissions  in  the  year  before  the 
demonstration  should  be  at  greater  risk  for  detection  of  previously  undiscovered  medical 
conditions  than  otherwise  similar  beneficiaries  with  prior  utilization. 

Among  the  fee-for-service  project  enrollees,  Medicare  nursing  facility  and  home  health 
agency  expenditure  and  utilization  during  Year  1  should  be  higher  for  experimental  than 
for  controls.  If  the  hypothesized  demonstration  effects  on  hospitalization  rates  among 
experimental  occur,  post-hospital  institutional  and  home  services  should  reflect  these 
effects. 

Findings:  Utilization  of  Total  Part  A  and  Hospital  Inpatient  Services 
Simple  comparisons  of  average  reimbursements,  admissions  and  days  per  admission 
between  comparison  and  experimental  groups  imply  that,  for  the  most  part,  the  availability 
of  preventive  services  generated  no  statistically  significant  effects  in  Year  1.  Exhibit  5-6 
shows  that  all  participants  in  managed  care  plans  were  less  likely  to  be 
hospitalized  ( 12. 1  percent  of  controls,  compared  to  18.4  percent  of  fee-for-service  controls), 
with  fewer  admissions  for  those  hospitalized  at  all  (1.19  average  admissions,  compared  to 
1.48  admissions),  and  stays  of  about  half  as  many  days  on  average  (6.23  days,  compared  to 
12.85  days).  But  differences  between  experimentals  and  controls  are  not  statistically 
significant  at  conventional  levels,  as  t-statistics  and  significance  estimates  in  Exhibit  5-6 
show;  only  for  hospital  admissions  in  managed  care  projects,  for  which  experimentals 
exceed  controls  by  0.12  admissions,  do  the  data  support  the  general 
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EXHIBIT  54 

COBRA  Medicare  Prevention  Demonstration  Evaluation 

Expenditure  and  Utilization  In  Year  1 
Medicare  Part  A:  Total  and  Hospital  Inpatient 
Fee-for-Serrice  and  Managed  Care  Projects 


Experimental  (E)      Control  (O        E  -  C 


Fee-for-Service  Projects* 

Total  Medicare  Pan  A  Expenditure 

Probability  of  Any  Part  A  19.3%  20.2%  -0.9 
Expenditures 

Total  Pan  A  Expenditures  per  $33.02  $32.02  $1.00 
Day  Alive  (if  greater  than  zero) 

Hospital  Expenditure  and  Utilization 

Probability  of  Hospital  17.6%  18.4%  -0.8 

Utilization 

If  Any  Hospitalizations: 

Hospital  Reimbursement  $8,954  $9,127  $-174 

Hospital  Admissions  Per  1.53  adms.  1.48  adms.  0.05 
Year 

Hospital  Days  per  12.33  days           12.85  days  -0.52 
Admission 

Managed  Care  Projects'* 

Probability  of  Hospital  11.7%  12.1%  -0.4% 

Utilization 

If  Any  Hospitalization: 

Hospital  Admissions  Per  1.31  adms.  1.19  adms.  0.12** 
Year 

Hospital  Days  per                        6.49  days           6.23  days  0.26 

Admission  

Source:  COBRA  Medicare  Prevention  Demonstration  Expenditure  and  Utilization  Files 

•Johns  Hopkins.  Pittsburgh,  UCLA 
bSan  Diego,  Washington 

Difference  significant  at  the  .01  level. 
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hypothesis  (that  hospital  utilization  will  increase  slightly  among  experimentals  relative  to 
controls).  At  the  same  time,  these  data  challenge  another  evaluation  hypothesis  about 
Year  1  effects  (that  utilization  will  be  lower  in  managed  care  than  in  fee-for-service 
projects).  Therefore,  in  a  framework  of  generally  insignificant  differences,  where  for  some 
measures  controls  exceed  experimentals  and  for  others  experimentals  exceed  controls,  it 
would  be  premature  to  interpret  this  isolated  significant  difference  as  a  finding. 

Both  short-  and  long-term  "effects"  of  the  intervention  on  the  utilization  of  acute 
services  are  expected  to  be  determined  by  exposure  to  preventive  services.  Roughly 
80  percent  of  experimentals  utilized  preventive  services  during  Year  1.  Therefore,  the 
average  utilization  differences  displayed  in  Exhibit  5-6  incorporate  behavior  of  preventive 
service  users  and  a  small  group  of  non-users.  It  is  important  to  remember  that  users  and 
non-users  in  the  expenditure  and  utilization  analyses  are  defined  by  their  behavior  within 
the  first  year  after  consenting  to  participate.  In  some  projects,  participants  scheduled  visits 
for  "first-wave"  preventive  services  during  the  second  year.  For  the  final  report  of  the 
evaluation,  records  of  preventive  services  utilization  will  be  sufficiently  complete  to  identify 
those  experimentals  who  received  the  full  intervention  at  any  point  during  the 
demonstration. 

In  order  to  interpret  evidence  for  the  association  between  preventive  and  non-preventive 
services  during  Year  1,  it  is  necessary  to  understand  who  among  experimental  group 
participants  did  not  use  preventive  services.  As  Exhibit  5-2  demonstrated,  experimentals 
who  used  preventive  services  in  Year  1  were  younger,  well-educated, 
predominantly  male,  and  likely  not  to  be  a  current  smoker.  Experimentals  in  managed 
care  projects  were  more  likely  to  use  preventive  services  than  fee-for-service  experimentals. 

Rates  of  preventive  services  use  were  also  associated  with  demonstration  status,  as 
Exhibit  5-7  shows.  Over  80  percent  of  experimentals  who  responded  to  a  second, 
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EXHIBIT  5-7 


COBRA  Medicare  Prevention  Demonstration  Evaluation 

Percent  Using  Preventive  Services  By  Demonstration  Status  Of  Experimentals 
Percent  in  Each  Status  Category  Using  Services 


Status 

All  Sites 

Johns  Hopkins 

Pittsburgh 

UCLA 

San  Diego 

Washington 

Participated  in 

81.4% 

66.6% 

88.3% 

76.8% 

99.6% 

84.7% 

Follow-up 

(4,378) 

(1,047) 

(1,382) 

(620) 

(671) 

(1,018) 

Lost  to 

Follow-up: 

Survived  First 

75.2% 

37.3% 

93.1% 

48.6% 

86.0% 

79.1% 

Year 

(1,444) 

(172) 

(973) 

(68) 

(178) 

(53) 

Died  in 

48.5% 

36.5% 

46.5% 

61.1% 

100.0% 

100.0% 

First  Year 

(79) 

(31) 

(20) 

(11) 

(16) 

(1) 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  Files. 
Note:  Numbers  of  beneficiaries  in  parentheses. 
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followup  round  of  surveys  in  the  five  projects  used  some  preventive  services  during 
Year  1.  In  contrast,  only  48.5  percent  of  experimental  who  died  in  Year  1,  and 
75.2  percent  of  individuals  who  survived  the  first  year  but  did  not  participate  in  a  follow-up 
survey,  used  preventive  services.  Preventive  services  utilization  rates  were  highest  in  all 
categories  for  San  Diego,  a  managed  care  project  that  recruited  relatively  young,  highly 
educated,  wealthy  participants,  and  lowest  for  Johns  Hopkins,  with  an  older,  less  educated, 
lower  income  population  served  through  physicians  in  a  variety  of  practice  settings.  In  all 
projects  except  Pittsburgh,  Year  1  survivors  lost  to  follow  up  were  less  likely  than  follow-up 
participants  to  have  used  preventive  services.  However,  as  noted  earlier,  Pittsburgh's  data 
are  not  comparable  to  data  from  other  sites  because  Pittsburgh  had  not  completed  all  of 
its  follow-up  interviews  by  the  end  of  the  second  year  of  the  demonstration,  and  some 
experimentals  categorized  as  "lost  to  follow-up"  may  still  consider  themselves  to  be 
participants  and  intend  to  comply  with  further  data  collection  efforts.22 

To  explore  further  the  association  between  preventive  and  non-preventive  services, 
logistic  and  ordinary  least  squares  regressions  were  used  to  estimate  adjusted  experimental- 
control  differences  in  the  probability  of  a  hospital  admission  and  in  the  number  of 
admissions  and  inpatient  days  per  admission  for  users  of  hospital  services 
respectively.  In  these  models,  experimentals  were  classified  as  users  (one  or  more 
preventive  visits  during  the  first  year  of  the  demonstration)  or  non-users.  Statistically 
significant  adjustor  variables  in  most  models  included  the  following  (Exhibit  5-8):  23 


Utilization  rates  in  Washington  for  Year  1  were  above  average,  even  though  two  participating  clinics  were 
delayed  in  delivering  preventive  services  3-4  months  because  of  a  labor  dispute. 

13 Some  variables  that  probably  explain  some  variation  in  hospital  utilization,  such  as  income,  retirement 
status,  and  living  arrangement,  were  missing  for  over  5  percent  of  enroilees  in  some  projects.  Others,  such  as  race, 
were  determined  by  the  target  populations  selected  by  the  demonstration  projects.  Pittsburgh  and  Washington 
recruited  virtually  no  racial  minorities.  UCLA  and  Johns  Hopkins  recruited  over  10  percent  non-white  enroilees. 
Variables  not  defined  for  all  projects,  missing  for  several  participants  in  certain  projects,  or  closely  identified  with 
the  recruiting  strategies  of  the  projects  were  not  used  in  the  adjustment  models. 
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EXHIBIT  5-8 


COBRA  Medicare  Prevention  Demonstration  Evaluation 


Non-Demonstration  Factors  Affecting  Use  Of 
Hospital  Inpatient  Services  During  Year  I 


Variable 


Age  (65-74) 
Age  (85+) 
Female 

College  Education 
Smoker 

One  or  More  Bed  Disability  Days 

At  Least  One  Inpatient  Admission 
Before  Demonstration 

Two  or  More  Inpatient  Admissions 
Before  Demonstration 

Inpatient  Days  Before  Demonstration  (If 
At  Least  One  Admission) 

Died  Within  First  Y 


Probability 
(Inpatient  Admission  >ff)a 


-2.53'* 
+5.75* 
3.55" 
-275" 
+  1.84  + 
+  3.87" 
+  13  24" 

+4.54" 

+0.13 

+44.24" 


If  Inpatient  ^Ubjsjjsjon  >  0 


Number  of  Admissions 

+0  05 
4.06 
-0.07* 
4  12" 
+0.07 
+0.05 
+0.10* 

+0.35" 

+0001 


Days  Per  Admission^ 


+045" 


Sonrce:  COBRA  Medicare  Demonstration  Expenditwre  and  Utilization  Files. 

■  Baaed  on  coeffcieata  ealiajated  at  a  logistic  regression  at  the  sample  mean,  converted  to  estimated  percentage  point  effects. 
^    Coefficients  of  w iflnwy  less!  njMrcs  regressjottn. 

Significant  at  the  .01  level. 
*   Significant  at  the  .05  level. 


-0.65 
+0.46 

4.76 

-3.09" 
+  1.42  + 

4.07 
I  12 

+  1.83 

+0  26" 

+  12.15" 


Age:  the  frequency  and  intensity  of  hospital  service  utilization  increased  with 
age. 

Gender:  Women  tended  to  use  hospital  services  less  than  men. 

Education:  Beneficiaries  with  some  college  education  used  fewer  hospital 
services  than  beneficiaries  with  less  education. 

Smoking  status:  Smokers  had  a  slight  tendency  to  be  hospitalized  more 
frequently  for  more  days  than  non-smokers. 

Pre-admission  utilization  (during  the  year  before  intake):  The  experiences  of 
having  had  self-reported  disability  days,  one  or  more  hospital  admissions,  and 
long  average  pre-demonstration  hospital  stays  were  associated  with  more  and 
longer  hospital  stays  during  Year  1. 

Death  during  Year  1:  Demonstration  participants  who  died  during  Year  1  had 
hospitalization  rates  5  to  6  times  higher  and  stays  twice  as  long  as  beneficiaries 
who  survived. 

In  contrast  to  the  statistically  insignificant  relationship  between  experimental  status  and 
hospital  utilization,  non-use  of  preventive  services  proved  to  be  closely  associated  with 
utilization  of  Medicare-reimbursed  hospital  services  in  Year  1.  Based  on  estimates 
computed  from  observations  pooled  across  all  projects,  experimentals  who  used  preventive 
services  and  controls  required  about  the  same  amount  of  hospital  services  in  Year  1. 
Exhibit  5-9  shows  negative  but  statistically  insignificant  differences  in  the  probability  of  at 
least  one  hospitalization  and  in  the  days  per  stay  for  hospital  users;  for  hospital  users, 
experimentals  appear  to  have  used  0.07  more  admissions  than  controls,  but  the  risk  of 
incorrectly  asserting  that  a  true  difference  exists  based  on  this  estimate  is  nearly  10  percent, 
significant  at  the  .10  level.  In  contrast,  the  relatively  few  experimentals  who  used  no 
preventive  services  during  Year  1  were  heavier  users  of  hospital  services  than  controls. 
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EXHIBIT  5-9 


COBRA  Medicare  Prevention  Demonstration  Evaluation 

Adjusted*  Estimates  Of  Experimental  -  Control  Differences  In  Hospital  Inpatient  Admissions 

And  Days  Per  Admission  During  Year  1 
All  Demonstration  Projects 


Difference 


Probability  (Admissions  >0)" 
(In  Percentage  Points) 


Experimental*  (With  Services) 

-  Controls 

Experimental*  (Without  Services) 

-  Controls 

Experimental!:  With  Services 

-  Without  Services 

N 

Sample  Mean   


-1.07 

+4.51** 

-5.58" 

14,004 
15.95% 


If  Admissions  >  0 
Number  or  Admissions 

+0.07  admissions  + 

-1-0.16  admissions**. 

-0.09  admissions4 

2,233 
1.45  admissions 


Days  Per  Admissions 

-0.19  days 

+2.13  days* 

-2.32  days* 

2,233 
11.12  days 


Soaree:  COBRA  Medicare  rYBvaxeioa  Deiaoaatratioo  Expendttvre  and  Utilization  Files. 


*    Adjusted  for  age. 


(college  or  higher).  smoker,  pec  demon*  r»<  ion  bed  disability  days,  inpatient 
ia  a  logistic  regression  evaluated  at  the  sample  mean,  converted  to  estimated  percentage 


and  days  per  admission,  died  during  Year  I. 

effects. 


Significant  at  the  .01  level. 
*  Significant  at  the  .05  level. 
4-  Significant  at  the  .10  level. 


The  rate  of  utilization  was  over  4  percentage  points  higher  for  experimentals;  those  who 
experienced  any  hospitalizations  were  admitted  for  0.16  more  admissions  and  stayed 
2.13  days  longer  than  hospital  users  in  the  control  group. 

Although  pooling  tends  to  conceal  structural  differences  among  the  diverse  projects  that 
participated  in  the  COBRA  demonstration,  estimates  presented  in  Exhibit  5- 10  suggest  that 
the  direction,  if  not  the  size  and  significance,  of  adjusted  estimates  of  experimental-control 
differences  for  non-users  is  replicated  in  most  of  the  five  separate  projects.  None  of  the 
estimated  differences  for  preventive  services  users  proved  to  be  statistically  significant,  but 
all,  except  San  Diego,  were  negative  (experimentals  appeared  somewhat  less  likely  than 
controls  to  be  hospitalized).  In  Pittsburgh,  UCLA  and  Washington,  experimentals  who  did 
not  use  preventive  services  experienced  hospitalization  rates  from  5  to  6  percentage  points 
higher  than  controls.  Estimates  for  Johns  Hopkins  and  San  Diego  were  not  statistically 
significant 

Some  experimentals  who  used  no  preventive  services  during  the  first  year  were 
undoubtedly  sicker  than  the  average  control  and  therefore  likely  to  be  at  higher  risk  of 
hospitalization.  Separate  estimates  of  the  probability  of  hospital  admissions  for 
experimentals  that  had  been  hospitalized  at  least  once  in  the  year  before  the  demonstration 
and  those  that  had  not  been  hospitalized  show  dramatically  different  patterns  for  non- 
participants  (Exhibit  5-11).  Previously  hospitalized  experimentals  who  used  no  preventive 
services  experienced  a  frequency  of  hospitalization  relative  to  controls  that  was  over  three 
times  the  rate  for  non-participants  with  no  prior  hospitalizations  (10.99  percentage  points, 
compared  to  3.21  percentage  points).  Both  exceeded  controls  by  statistically  significant 
margins,  suggesting  that,  regardless  of  pre-demonstration  utilization  patterns,  non- 
participating  experimentals  were  less  healthy  than  the  average  control  group  member.  It 
is  tempting  to  interpret  the  negative  estimates  for  participating  experimentals  as  showing 
that  use  of  preventive  services  deterred  hospitalizations  and  that  the  deterrent  effect  was 
larger  for  experimentals  who  had  been  hospital  users  before  the  demonstration.  However, 
neither  coefficient  is  statistically  significant 
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EXHIBIT  5-10 


COBRA  Medicare  Prevention  Demonstration  Evaluation 


Adjusted*  Estimates  of  Experimental-Control  Differences  (In  Percentage  Points): 
Probability  of  Hospital  Inpatient  Admission*  By  Demonstration  Project 


Differences 

Johns 
Hopkins 

Pittsburgh 

UCLA 

San  Diego 

Washington 

Experimentals 

(With  Services)  -  Controls. 

-0.89 

-1.32 

-0.38 

-2.32 

Experimentals 

(Without  Services)  -  Controls 

+  1.63 

+6.51  ' 

+5.50  * 

-0.61 

+5.99  * 

Experimentals! 

WHh  Services  - 
Without  Services 

-2.52 

-7.83  " 

-5.88  * 

-1.22 

-8.31  - 

N 

4,129 

3,855 

1,847 

1,685 

2,488 

Sample  Mean 

19.64% 

16.24% 

16.46% 

8.34% 

14.11% 

Source:  COBRA  Medfcara  Preveutkju  Demonstration  Expenditure  and  Utilization  Files. 


•  Adjusted  for  nfB,  gender,  edncnttoa  (college  or  higher),  smoker,  predemonstratkm  bed  disability  days,  inpatient  admissions,  and  days  per  admission,  died  during  Year  I . 

•  Based  on  uieMiknU  tetinlrd  h  a  logistic  regression  evaluated  at  the  sample  mean,  converted  to  estimated  percentage  point  effects. 

Significant  at  aVa  .01  level. 

•  Significant  at  Ihe  .05  level. 
+  Significant  at  the  .10  level. 


EXHIBIT  5-11 


COBRA  Medicare  Prevention  Demonstration  Evaluation 

Adjusted*  Estimates  of  Experimental-Control  Differences  (In  Percentage  Points): 
Probability  of  Hospital  Inpatient  Admissions1*  During  Year  1 
By  Pre- Demonstration  Hospital  Admissions  (>0) 
All  Demonstration  Projects 


Differences 

One  or  More  Pre- Demonstration 

WW  "  .  |      A      |          •      .  *    .  / WT                   Wtmmt  ,.  mm     t  — 

Hospital  Admissions  (Year  Prior  to 
Intake) 

No  lYe- Demonstration  Hospital 
Admissions 

Experimentals 

(With  Services)  -  Controls 

-3.46 

-0.67 

Experimentals 

(Without  Services)  -  Controls 

+  10.99  M 

+3.21  M 

Experimentals: 
With  Services  - 
Without  Services 

-14.45  " 

-53.88  •* 

N 

1,956 

12,048 

Sample  Mean 

32.11% 

13.33% 

Source:   COBRA  Medicare  Prevention  Demonstration  Expenditure  and  Utilization  Files. 


'  Adjusted  for  age,  fender,  education  (college  or  higher),  smoker,  predemonstration  bed  disability  days,  inpatient  admissions  and  days  per  admission,  died  during  Year 
b    Based  on  coefficients  estimated  in  a  logistic  regression  evaluated  at  the  sample  mean,  converted  to  estimated  percentage  point  effects. 

*♦  Significant  at  the  .01  level. 


Findings:  Utilization  of  nursing  facility  and  home  health  services 

The  few  demonstration  participants  who  used  Medicare  Part  A-reimbursed  nursing 
facility  or  home  health  services  in  the  fee-for-service  projects  did  not  seem  to  be  influenced 
by  group  membership.  (Managed  care  project  data  on  nursing  home  and  home  health  care 
utilization  were  not  available  for  this  report.)  As  Exhibit  5-12  shows,  less  than  1  percent 
had  any  nursing  facility  use  and  about  7  percent  used  home  health  agency  services. 
Unadjusted  comparisons  of  frequency  and  expenditures  showed  no  statistically  significant 
differences  between  experimental  and  controls. 

Pre-demonstration  utilization  patterns  were  associated  with  the  use  of  nursing  facility 
and  home  health  services  during  Year  1  (Exhibit  5-13).  Beneficiaries  who  had  been 
hospitalized  before  the  demonstration  were  more  likely  during  the  first  year  of  the 
demonstration  to  use  both  nursing  facility  services  (2.35  percent  had  some  nursing  facility 
use,  compared  to  0.67  percent  for  beneficiaries  with  no  prior  hospitalizations)  and  home 
health  services  (15.17  percent,  compared  to  4.99  percent).  Seventeen  percent  of  pre- 
demonstration  nursing  facility  users  used  some  nursing  facility  services  in 
Year  1  (compared  to  0.89  percent  of  participants  with  no  prior  nursing  facility  use),  and 
35.79  percent  of  pre-demonstration  home  health  users  had  at  least  one  home  health  visit 
during  Year  1,  compared  to  5.18  percent  of  those  with  no  prior  use. 

Preventive  services  utilization  among  experimentals  proved  to  be  associated  with 
utilization  of  nursing  facility  and  home  health  services,  as  it  was  with  hospital  use 
(Exhibit  5-14).  Nursing  facility  admissions  for  those  experimentals  that  utilized  preventive 
services  were  less  than  half  the  admissions  for  experimentals  with  no  preventive  services 
(an  average  of. 008  admissions,  compared  to  .021  admissions).  Similarly,  home  health  visits 
among  preventive  services  users  averaged  1.17,  compared  to  2.42  among  non-users. 
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EXHIBIT  5-12 


COBRA  Medicare  Prevention  Demonstration  Evaluation 

Expenditure  And  Utilization  In  Year  1 
Medicare  Part  A:  Nursing  Facility  And  Home  Health 
Fee-For-Senrice  Projects* 


Experimental  (E)     Control  (Q  E-C 


Medicare  Part  A 
Nursing  Home 

Probability  of  Any 
Nursing  Home  Use 

If  Any  Use: 

Nursing  Home 
Admissions 

Nursing  Home 
Days  per 
Admission 

Total  Pan  A 
Nursing  Home 
Reimbursement 

Medicare  Part  A 
Home  Health 

Probability  of  Any 
Home  Health  Use 

If  Any  Use: 

Home  Health 
Visits 

Total  Pan  A 
HHA  Reim- 
bursement 


0.33% 


1.20  adms. 


26.0  days 


$2,672 


6.7% 


21.9  visits 


$1,274 


0.23% 


1.23  adms. 


31.7  days 


$3,892 


6.5% 


23.2  visits 


$1,367 


0.10 

-0.03 
-5.70 

-$1,220 


0.20 

-1.30 
-$93 


Source:  COBRA  Medicare  Prevention  Demonstration  Expenditure  and  Utilization  File. 
•Johns  Hopkins.  Pittsburgh,  UCLA. 
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EXHIBIT  5-13 
COBRA  Medicare  Prevention  Demonstration  Evaluation 


ion  Participants  Utilizing  Nursing  Facility  And  Home  Health  Agency  Services 
During  Year  I  In  Fee-For-Senrfce  Projects" 
By  Utilization  In  The  Pre- Demonstration  Year 


Hospital  Inpatient 
None 

One  or  More  Admissions 
Nursing  Facility 
None 

One  or  More  Days 
Home  Health 

None 

One  or  More  Visits 


Year  1  of  the  Demonstration 
Nursing  Facility  Home  Health  Agency 


0.67% 
2.35% 

0.89% 
17.24% 

0.0 
0.0 


4.99% 
15.17% 

0.0 
0.0 

5.18% 
35.79% 


Soarce:  COBRA  Medicare  ftwaafloa  Demonstration  Expenditure  and  Utilization  File. 
■Johns  Hopkins.  UCLA.  Pittsburgh. 


EXHIBIT  5-14 


COBRA  Medicare  Prevention  Demonstration  Evaluation 

Utilization  of  Medicare  Part  A  -  Reimbursed  Nursing  Facility  and  Home  Health  Agency 
Services  By  Experimental  Group  Participants  During  Year  1  in  Fee-For-Service  Projects" 
By  Use  of  Demonstration  Preventive  Services 


YEAR  1  Utilization 


Used  Some 
Demonstration  Services 


Used  No  Services 


Nursing  Facility  Admissions 


0.008  admissions 


0.021  admissions 


Home  Health  Agency  Visits 


1.17  visits** 


2.24  visits' 


Source:  COBRA  Medicare  Prevention  Demonstration  Expenditure  and  Utilization  Files 
'Johns  Hopkins,  Pittsburgh.  UCLA. 
**  Difference  significant  at  .01  level. 


Discussion 

Preliminary  analyses  suggest  that  the  availability  of  preventive  services  during  the  first 
year  of  the  demonstration  did  not  affect  utilization  of  Medicare-reimbursed  acute  care 
services.  This  finding  was  confirmed  in  most  of  the  projects.  Neither  the  organizational 
model  of  the  projects  (managed  care  versus  fee-for-service)  nor  pre-demonstration 
utilization  patterns  of  the  enrollees  were  associated  with  statistically  significant 
demonstration  effects.  However,  these  analyses  also  demonstrated  a  clear  selection  effect 
operating  through  the  decision  by  experimentals  to  utilize  or  not  utilize  preventive  services. 

Among  the  experimentals,  those  who  used  no  preventive  services  were  more  likely  to 
be  hospitalized,  had  longer  hospital  stays,  and  were  more  likely  to  use  nursing  facility  and 
home  health  services  than  experimentals  who  used  preventive  services.  The  relatively 
small  number  of  experimentals  who  used  no  demonstration  services  included: 

some  who  died,  many  of  whom  were  hospitalized  and  effectively  unable  to 
participate  in  the  demonstration; 

some  who  were  ill  and  hospitalized  but  survived  the  year  --  a  certain  percentage 
of  these  had  been  hospitalized  in  the  year  before  the  demonstration  and 
probably  entered  predisposed  to  illness  and  further  hospitalizations  during  the 
demonstration.  Others,  with  no  prior  use,  required  hospitalization  during  Year 
1  and  may  have  been  too  ill  to  participate. 

some  who  survived  the  year  without  major  medical  events  and  who  did  not 
participate,  for  various  reasons;  some  moved  out  of  the  area;  some  may  have 
decided  not  to  participate  for  personal  reasons. 

Although  experimental  participants  used  significantly  fewer  acute  care  services  than  non- 
participants,  they  did  not  differ  in  this  regard  from  the  controls.  The  hypothesized  first- 
year  increase  in  acute  care  use  among  experimentals  who  were  screened  and  counseled  did 
not  materialize.  No  statistically  significant  reductions  were  detected  in  utilization  among 
experimental  participants  relative  to  the  controls,  although  the  direction 
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of  estimated  differences  slightly  suggested  lower  utilization  among  experimentals. 
Preventive  services  users  were  clearly  a  self-selected  majority  of  experimentals  who 
appeared  to  be  at  less  risk  of  experiencing  acute  health  problems  than  non-users. 

In  summary,  the  first  year  of  the  COBRA  demonstration  did  not  produce  any  findings 
to  suggest  that  the  availability  of  preventive  services  affected  the  use  of  acute  care  services. 
Rather,  the  evidence  indicates  that,  for  a  minority  of  experimentals  who  failed  to  use 
preventive  services  during  Year  1,  the  compelling  need  for  acute  services  displaced  (and 
for  some,  may  have  postponed)  the  use  of  the  preventive  visits  available  to  them  through 
the  demonstration.  For  80  percent  of  the  experimentals  who  actively 
participated,  neither  increases  in  utilization  (associated  with  the  detection  of  previously 
undiscovered  conditions)  nor  reductions  associated  with  changes  in  risk  were  detected. 

One  year  cannot  provide  an  adequate  test  of  prevention  effects  on  utilization  of  acute 
health  care  services  among  the  elderly.  Over  the  longer  time  frame  of  the  demonstration, 
some  experimentals  who  survive  but  who  did  not  participate  during  the  first  year  may 
receive  demonstration  services  and  experience  improvements  in  health  status  and 
reductions  in  utilization.  Participants  who  were  screened  and  counseled  as  part  of  the 
demonstration  in  Year  1  may  experience  induced  reductions  in  acute  utilization  in  later 
years.  The  final  report  on  the  COBRA  demonstration  will  present  a  fairer  test  of 
prevention  effects,  by  capturing  changes  in  acute  care  use  over  a  4-year  period. 
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6.0      EFFECTS  OF  THE  DEMONSTRATION  ON  BENEFICIARY  HEALTH  AND 
FUNCTIONAL  STATUS 


6.1  Overview 

One  goal  of  the  COBRA  prevention  demonstrations  was  to  determine  whether 
preventive  services  would  lead  to  improved  health  and  functional  outcomes  for  Medicare 
beneficiaries.  This  chapter  presents  the  results  of  descriptive  analyses  and  testing  of  the 
hypotheses  which  were  posited  a  priori  in  the  crosscutting  evaluation  design  and  are 
enumerated  below. 

Hypothesis  1:  The  intervention  will  have  no  short-term  effect  on  participants'  self- 
reported  health  status. 

Alternative  hypothesis:  The  intervention  will  have  no  short-term  effect  on 
participants'  self-reported  health  status  but  will  have  a  positive  effect  in  the  long  run. 
Disease  detection  and  a  possible  increase  in  health  services  utilization  following  the 
initial  intervention  may  negatively  influence  some  participants'  perceptions  of  their 
health  status.  Follow-up  clinical  interventions  should  result  in  improved  health  status 
in  the  long  run. 

Hypothesis  2:  The  intervention  will  have  no  short-term  effect  on  the  rate  of  decline 
in  participants'  functional  status. 

Alternative  hypothesis:  The  intervention  will  have  no  short-term  effect  on  the  rate 
of  decline  in  participants'  functional  status,  but  will  be  associated  with  a  deceleration 
in  functional  decline  over  the  long  run. 

This  chapter  is  organized  as  follows.  Section  6.2  describes  the  data  sources  and 
limitations,  dependent  variables  and  analytic  approach  used  for  these  outcome  analyses. 
Section  6.3  describes  the  sample  of  beneficiaries  by  experimental  group  and  discusses 
differences  in  this  sample  across  study  sites.  Section  6.4  presents  results  of  bivariate 
analyses  of  outcome  data.  This  chapter  concludes  with  the  presentation  of  the  results  of 
multivariate  analyses  and  hypotheses-testing  in  Section  6.5. 
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6.2      Data  Issues 

This  section  describes  the  data  sources  that  were  used  for  the  outcome  analyses,  and 
the  limitations  of  these  data.  Dependent  variables  and  relevant  measurement  problems  are 
then  described  and  the  analytic  approach  is  presented. 

6.2.1  Data  Sources  and  Limitations 

The  data  used  in  the  health  and  functional  outcome  analyses  were  collected  by  the 
five  demonstration  projects  at  baseline  (pre-intervention)  and  follow-up  (post-intervention) 
through  personal  interviews,  telephone  interviews  and/or  written  questionnaires  with 
Medicare  beneficiaries  who  agreed  to  participate  in  this  study.  These  data  were  processed 
by  the  projects  and  were  submitted  to  the  crosscutting  evaluation  contractor. 

Although  the  contractor  had  specified  the  MDS  for  this  crosscutting  evaluation  a 
priori,  the  data  files  submitted  by  the  sites  did  not  contain  all  specified  data  elements.  The 
contractor  attempted  to  construct  a  reduced  version  of  the  MDS  based  upon  the  availability 
of  the  projects'  data.  Because  the  outcome  analyses  required  both  baseline  and  follow-up 
measures  of  the  dependent  variables,  those  projects  in  which  either  measure  is  missing  are 
excluded  from  analyses.  Health  and  functional  outcomes  that  were  only  available  in  one 
project  were  excluded:  transferring  from  bed  to  chair,  shopping,  doing  light  housework  and 
cooking.  Finally,  since  the  projects  asked  different  questions  to  collect  the  MDS  items, 
these  measures  were  not  always  comparable  across  projects.  As  is  described  in  Section 
6.2.2.,  health  and  function  outcomes  were  recoded  so  that  they  could  be  compared  across 
projects. 

6.2.2  Definition/Construction  of  Dependent  Variables 

Changes  in  health  status  are  analyzed  by  examining  three  measures:  self-reported 
health  status,  number  of  beddays  and  number  of  falls.  Self-reported  health  status 
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(i.e.,  excellent,  very  good,  good,  fair  and  poor)  has  been  used  in  numerous  studies  and  has 
been  found  to  be  a  good  predictor  of  lower  mortality  and  longer  survival  (Idler  et  al., 
1990).24 

Bed  days  is  another  good  indicator  of  health  status.  Although  the  referent  time 
periods  were  different  across  projects,  a  measure  of  the  number  of  days  in  which  the 
beneficiary  spent  all  or  most  of  the  day  in  bed,  on  a  couch  or  in  a  chair,  was  computed.  In 
three  projects,  (San  Diego,  Washington  and  Johns  Hopkins)  this  measure  was  taken  from 
the  physical  activity  scale  of  the  Quality  of  Well-Being  (QWB)  Instrument:  two  projects 
used  a  4-day  period  and  one  project  used  a  6-day  period.  In  the  remaining  projects,  the 
reporting  period  was  the  past  12  months.  The  numbers  of  bed  days  between  baseline  and 
follow-up  were  computed,  and  a  changes  score  (i.e.,  decrease,  no  change  or  increase)  was 
computed.  A  dichotomous  measure  of  any  bed  days  vs.  no  bed  days  was  used  in  the 
multivariate  analysis. 

Many  of  the  conditions  which  may  predispose  an  individual  to  fall  (e.g.,  hypertension, 
side  effects  of  medication)  are  health  problems.  The  morbidity  and  other  sequelae  of  falls 
among  the  elderly  also  are  indicative  of  health  problems.  The  number  of  falls  during  the 
past  year  for  all  projects  was  examined. 

Change  in  functional  status  was  examined  for  seven  measures:  dependence  in 
bathing,  dressing,  traveling  (getting  to  places  by  car  or  public  transportation)  and  stamina. 
These  measures  were  available  for  Johns  Hopkins,  UCLA  and  Washington.  For  the  three 
projects  who  used  the  QWB,  step  scores  (weighted)  for  the  mobility,  physical  activity  and 
social  activity  scales  were  compared. 

Bathing  and  dressing  dependence  capture  individuals  at  lower-functioning  levels  and 
travel  dependence  captures  individuals  at  relatively  higher-functioninglevels,  consistent  with 
the  LADL-ADL  hierarchical  structure  proposed  by  Spector  and  his  colleagues  (1987). 
Independence  is  defined  as  performing  the  activity  without  personal  assistance  and 
dependence  is  receiving  assistance  or  not  performing  the  activity.  Bathing  and  dressing 


Owing  to  confusion  over  San  Diego's  coding  of  self-reported  health  status,  their  data  were  excluded  from 
the  analysis  of  this  outcome.  They  will  be  included  in  the  Final  Report  of  the  evaluation. 
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items  were  derived  from  the  QWB  Social  Activity  Scale  and  travel  from  the  QWB  Mobility 
Scale  for  the  projects  using  this  instrument.  Project  differences  in  the  travel  construct  were 
examined  using  a  logistic  regression  controlling  for  age,  sex,  and  having  a  hospital  admission 
during  the  year  prior  to  baseline  interview.  A  very  strong  site  effect  was  observed  for  the 
projects  whose  outcome  measures  were  derived  from  different  sources.  Some  of  this 
observed  difference  may  be  due  to  other  factors.  Site  measurement  differences  were 
controlled  in  multivariate  models  through  a  site  by  baseline  outcome  interaction  term. 

The  stamina  measure  is  indicative  of  higher  function  (Mor  et  al.,  1989).  As  specified 
in  the  MDS,  this  measure  was  to  be  composed  of  three  questions,  in  which  the  difficulty  of 
lifting/carrying  25  pounds,  walking  a  quarter  of  a  mile,  and  walking  up  10  steps  without 
resting  was  assessed.  In  the  projects  that  used  the  original  questions,  a  respondent  was 
classified  as  dependent  if  he/she  reported  any  difficulty  performing  at  least  one  of  these 
activities  during  the  past  month.  In  two  projects  using  the  QWB,  dependence  was  defined 
as  any  trouble/not  trying  to  lift,  stoop,  bend  over  or  use  stairs  or  inclines  during  the 
past  4  days.  Although  the  QWB  Physical  Activity  Scale  also  included  an  item  that  indicated 
having  any  physical  limitation/not  trying  to  walk  as  far  or  as  fast  as  most  persons  their  age 
are  able,  this  item  was  not  included  in  the  construct  Strong  site  effects  were  also  observed 
in  a  logistic  regression  which  controlled  for  age,  sex  and  prior  hospitalization. 

The  QWB  includes  mobility,  physical  activity  and  social  activity  scales  of  function, 
and  each  step  on  these  scales  has  its  own  associated  weight  For  beneficiaries  at  Hopkins 
and  Washington  (data  were  not  available  for  San  Diego),  the  weights  were  added  for  the 
appropriate  level  of  function  on  each  scale  and  then  each  sum  was  subtracted  from  1.0  to 
obtain  measures  of  functional  status.  These  measures  were  used  to  compute  changes  from 
baseline  to  follow-up. 

6.2.3    Analytic  Approach 

The  hypothesis  testing  analyses  follow  the  intent  to  treat  model  and  include  all 
subjects  allocated  to  the  experimental  group,  whether  or  not  they  actually  received  the 
intervention.  Each  analysis  is  computed  for  enrollees  for  whom  baseline  and  follow-up 
measures  are  available. 
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The  first  set  of  analyses  compares  the  experimental  and  control  groups  across  health 
status  measures  and  functional  status  measures.  Baseline  data  and  the  change  scores  from 
baseline  to  follow-up  are  presented  for  each  health  status  measure.  Only  baseline  and 
follow-up  measures  are  presented  for  functional  status.  Pearson's  chi-square  statistic  is  used 
to  test  whether  outcomes  are  associated  with  experimental  status. 

The  next  set  of  analyses  tests  the  effect  of  the  intervention  on  the  dependent 
variables  of  interest  while  controlling  for  sociodemographic  and  other  factors.  Multivariate 
models  test  hypotheses  regarding  differences  between  experimentals  and  controls  on  a  given 
follow-up  dependent  variable.  Logistic  regression  is  used  for  binary  dependent  variables 
(bed  days,  falls,  dependence  in  bathing  or  dressing,  dependence  in  travel,  dependence  in 
stamina).  Continuous  measures  (QWB  functional  status  scores)  are  modeled  using  linear 
least  squares  regression.  Ordinal  logistic  regression  is  used  for  the  ordered  outcome 
variable  self-rated  health. 

In  addition  to  an  experimental  group  indicator,  each  model  includes  dummy  variables 
for  each  project  and  covariates  to  control  for  sociodemographic  factors  (age,  sex,  race, 
education,  income,  lives  alone,  completely  retired),  the  number  of  days  between  baseline 
and  follow-up  interviews,  whether  there  were  any  hospital  admissions  during  year  prior  to 
baseline  interview,  and  the  baseline  measure  of  the  variable.  By  controlling  for  the  project 
and  the  baseline  measure  of  each  outcome,  and  by  introducing  a  project-by-baseline- 
measure  interaction  term,  the  effect  of  measurement  problems  due  to  noncomparable 
questions  or  referent  time  periods  across  projects  will  be  reduced. 

63      Sample  Description 

This  section  describes  the  sample  used  for  the  health  and  functional  outcome 
analyses.  As  was  described  in  chapter  3.0,  differential  attrition  was  observed  from  baseline 
to  follow-up  for  experimental  and  control  beneficiaries  in  one  project  Experimentals  in 
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Pittsburgh,  particularly  those  who  received  services,  were  significantly  underrepresented.25 
As  a  result,  Pittsburgh  was  excluded  from  the  health  and  functional  outcome  analyses. 

The  socio-demographic  characteristics  of  the  sample  of  beneficiaries  used  in  the 
health  and  functional  outcome  analyses  is  presented  by  experimental  status  in  Exhibit 
6-1.  Across  all  projects,  the  two  groups  are  quite  comparable,  with  the  exception  that 
experimental  beneficiaries  are  slightly  more  likely  (p<.05)  to  be  white  than  control 
beneficiaries.  The  sample  is  predominantly  white,  mostly  female  and  has  a  mean  age  of 
nearly  73  years  of  age  at  baseline.  Almost  60  percent  of  study  members  are  married,  over 
40  percent  attended  college  and  nearly  two-thirds  are  completely  retired.  Less  than  one- 
third  of  beneficiaries  live  alone  and  approximately  14  percent  have  household  incomes  less 
than  $5,000  while  15  percent  report  incomes  greater  than  $35,000. 


As  mentioned  previously,  the  evaluation  contractor  obtained  about  75  percent  of  the  total  followup  sample 
from  Pittsburgh. 
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EXHIBIT  6-1 

COBRA  Medicare  Prevention  Demonstration  Evaluation 


Comparison  Of  Sociodemographic  Characteristics  Of  Experimental 
and  Control  Groups  For  Outcome  Analyses* 


Sociodemographic  Measure 

Experimental 
(n-4255) 

Control 
(n-4279) 

ToUl 
(n*8534) 

Mean  Age  (yean) 

72.9 

72.9 

72.9 

%  Females 

60.1 

60.5 

60.3 

%  White  • 

90.9 

89.5 

90.2 

*  Married 

57.9 

57.7 

57.8 

£  Living  Alone 

32.1 

31.5 

31.8 

%  Completely  Retired 

68.6 

68.2 

68.4 

S  Who  Attended  College 

41.5 

40.8 

41.1 

*  With  Income  <  $5,000 

14.1 

13.4 

13.7 

*  With  Income  >  $35,000 

15.3 

15.4 

15.3 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  D»u  Set. 
'Differences  ber*e*n  treatment  groups  are  significant  it  the  .05  level. 
'Pittsburgh  beneficiaries  are  not  included 


36 


6.4      Bivariate  Analyses  of  Outcomes 

Health  measures  for  the  outcome  analyses  consist  of  self-reported  health,  bed  days 
and  falls.  As  shown  in  Exhibit  6-2,  the  two  treatment  groups  report  comparable  levels  of 
health  status  at  baseline.  When  the  change  in  health  status  from  baseline  to  followup  was 
computed,  experimentals  were  less  likely  (p<  01)  to  improve  between  baseline  and  followup. 
Although  the  number  of  bed  days  declined  for  7  percent  of  study  members  between  baseline 
and  followup,  bed  days  increased  by  approximately  the  same  percentage  and  no  difference 
was  observed  as  a  function  of  experimental  status.  A  significant  difference  was  observed 
in  the  change  in  number  of  falls  from  baseline  to  follow  up  with  experimentals  slightly  more 
likely  (p<  l)  to  experience  a  decline  in  the  number  of  falls. 

Functional  status  measures  for  the  outcome  analyses  include  two  ADL  measures 
(bathing  and  dressing),  and  two  LADL  measures  (traveling  and  stamina).  Exhibit  6-3 
presents  the  distribution  of  dependence  in  these  measures  by  group  at  baseline  and  at 
follow-up.  Although  the  two  groups  are  similar  at  baseline,  experimentals  are  slightly  more 
likely  to  report  dependence  in  dressing  at  follow-up.  Although  the  percentage  of 
beneficiaries  reporting  to  be  dependent  is  slightly  higher  at  follow-up,  there  are  no  between- 
group  differences  in  the  proportion  of  beneficiaries  who  did  not  travel  at  baseline  or  follow- 
up.  Similarly,  nearly  30  percent  of  the  sample  is  dependent  in  the  stamina  construct,  but 
no  differences  were  observed  between  groups  at  baseline  or  follow-up. 

Changes  in  functional  status,  as  measured  by  the  mobility,  physical  activity  and  social 
activity  scales  of  the  QWB,  were  also  examined.  As  can  be  seen  in  Exhibit  6-4,  no 
differences  were  observed  between  groups  in  the  computed  change  score.  A  greater 
proportion  of  individuals  improved  in  the  social  activity  and  physical  activity  scales  than  the 
mobility  scale. 

Although  few  differences  were  observed  by  experimental  status,  the  characteristics 
of  the  sample  vary  by  project  and  the  distribution  of  sample  members  is  not  equal  across 
sites.  Because  of  these  differences  the  effect  of  the  intervention  can  only  be  tested  in  a 
regression  framework,  controlling  for  sociodemographic  and  other  factors  which  may 
influence  the  outcomes  being  examined. 
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EXHIBIT  6-2  ' 


COBRA  Medicare  Prevention  Demonstration  Evaluation 


Comparison  Of  Health  Outcome  Measures 
Of  Experimental  And  Control  Groups* 


Health  Outcome  Measures 

Experimental 
(n-4255) 

Control 
(n-4279) 

Total 
(n-8534) 

Self-Reported  Health  Status 

at  Baseline" 

• 

Excellent 

13.0 

13.4 

13.2 

Very  Good 

33.0 

33.0 

33.0 

Good 

34.0 

33.4 

33.7 

Fair 

16.2 

16.8 

16.5 

Poor 

3.8 

3.5 

3.6 

Self-Reported  Health  Sums 

Change  at  Follow-Up  " 

Improved 

24.5 

27.0 

25.8 

No  Change 

54.5 

54.0 

54.2 

Declined 

21.0 

19.0 

20.0 

Change  in  #  Bed  Days  from 

Baseline  to  Follow-Up 

Declined 

6.7 

7.3 

7.0 

No  Change 

86.1 

85.4 

85.8 

Increased 

7.2 

7.3 

7.3 

Change  in  #  Falls  from 

Baseline  to  Follow-Up*" 

Declined 

20.1 

17.6 

18.8 

No  Change 

63.1 

64.7 

63.9 

Increased 

16.9 

17.8 

17.3 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  (MDS). 


*  Differences  between  treatment  groups  are  significant  at  the  .10  level. 
**  Differences  between  treatment  groups  are  significant  at  the  .01  level. 

Note:  Numbers  may  not  total  100.0%  due  to  rounding. 

'   Pittsburgh  beneficiaries  are  not  included. 

b  Sao  Diego  data  excluded  due  to  noo comparable  coding 
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EXHIBIT  6-3 

COBRA  Medicare  Prevention  Demonstration  Evaluation 
Comparison  Of  Functional  Status  Measures  Of  Experimental  And  Control  Groups" 


Functional  Status 
Measures 

Experimental 
<n«3574) 

Control 
(n*3568) 

Total 
(n«7142) 

%  Dependent  in  Bathing 

Baseline 

4.6 

4.1 

4.3 

j.  a 

*  c 

J.J 

*.  A 
j.O 

%  Dependent  in  Dressing 

Baseline 

2.9 

2.6 

2.7 

Fnllnu  -tin"*" 

4  5 

4  1 

%  Who  Do  Not  Travel 

Baseline 

13.9 

14.7 

14.3 

Follou-Up 

15.8 

15.0 

15.4 

5t  Dependent  on  Stamina 

Baseline 

28.7 

29.6 

29.2 

Follow-Up 

28.2 

28.1 

28.1 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Dtu  Set. 

*  Difference*  between  treatment  groups  arc  significant  at  the  .10  level. 

"Tbcec  measures  were  available  for  Johns  Hopkins,  UCLA  and  Washington  only. 
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EXHIBIT  6-4  k 
COBRA  Medicare  Prevention  Demonstration  Evaluation 
Comparison  Of  Quality  Of  Well-Being  Measures  Of  Experimental  And  Control  Groups" 


Functional  Status                        Experimental     Control  Total 

Measures  (n«2706)  (n«2716)  (n«S425) 

QWB  -  Mobility 

%  Declined  11.1  n.i  hj 

*  No  Change  79.2  78.2  78.7 

%  Improved  9.7  10.7  10.2 

QWB  -  Physical  Activity 

%  Declined  19.5  18.3  18.9 

%  No  Change  64.8  65.0  64.9 

%  Improved  15.7  16.7  16.2 

QWB  -  Social  Activity 

S  Declined  13.1  12.7  12.9 

%  No  Change  69.2  67.6  68.4 

$  Improved  17.7  19.6  18.7 


Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  (MDS) 

Note:  Numbers  may  not  total  100.0%  due  to  rounding. 

These  measures  were  available  for  Johns  Hopkins  and  Washington  only. 
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6.5     Multivariate  Analyses  of  Outcomes 

In  this  section  the  results  of  the  multivariate  models  testing  hypotheses  regarding 
differences  between  experimentals  and  controls  on  a  given  follow-up  dependent  variable  are 
presented.  Logistic  regression  is  used  for  binary  dependent  variables  (bed  days,  number  of 
falls,  independence  in  bathing  and  dressing,  independence  in  travel,  and  stamina). 
Continuous  measures  (QWB  functional  status  scores)  are  modeled  using  linear  least  squares 
regression.  Ordinal  logistic  regression  is  used  for  the  ordered  outcome  variable  self-rated 
health. 

Because  of  the  significant  differences  in  the  composition  of  the  study  sample  across 
projects,  models  controlled  for  those  sociodemographic  characteristics  that  differed  by 
project  or  that  could  influence  the  outcome  measures.  Age  was  included  in  the  models  as 
a  continuous  variable.  Binary  variables  (0=no,  l=yes)  included  member  of  experimental 
group,  female,  white  race,  college-educated,  a  household  income  of  less  than  $5,000,  a 
household  income  of  greater  than  $35,000,  living  alone,  and  completely  retired.  In  order 
to  control  for  the  existence  of  prior  health  problems,  the  models  included  a  binary  variable 
indicating  whether  the  beneficiary  had  any  hospital  admissions  during  the  year  prior  to  the 
baseline  interview.  Because  not  all  projects  conducted  their  follow-up  interviews  at  the 
same  time  relative  to  the  baseline  interview,  a  continuous  measure  of  the  number  of  days 
between  baseline  and  follow-up  was  also  included.  Finally,  to  control  for  the  differences 
between  projects  as  well  as  outcome  measurement  differences  by  project,  the  model 
included  project  dummy  variables,  the  baseline  measure  of  the  outcome  and  project-by- 
baseline-outcome  interaction  terms. 

The  results  of  these  analyses  of  the  independent  effect  of  the  intervention  on  health 
and  function  outcomes  at  follow-up  are  summarized  in  Exhibit  6-5.  Odds  ratios  and 
95  percent  confidence  intervals  are  presented  for  the  experimental  effect,  while  controlling 
for  all  variables  in  the  model.  As  shown  in  Exhibit  6-5,  being  a  member  of  the  intervention 
group  resulted  in  a  12  percent  improvement  in  self-reported  health  status.  Experimental 
effects  were  not  detected  for  the  other  outcome  measures  which  were  examined. 
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EXHIBIT  6-5 


COBRA  Medicare  Prevention  Demonstration  Evaluation 

Adjusted  Odds  Ratios  And  95%  Confidence  Intervals  Of  The  Effect  Of  Experimental 
Status  On  Function  Outcomes  At  Follow-Up* 


Outcome 

Adjusted  Odds 
Ratio 

95%  Confidence 
Interval 

Health  Outcomes  at  Follow-Up 

Better  Self-Rated  Healthb 

1.121* 

1.0221  -  1.2293 

Any  Bed  Days 

.962 

.8011  -  1.11545 

nny  rails 

.895 

.7766  -  1.0303 

Function  Outcomes  at  Follow-Up 

Independence  in  Bathing 

.916 

.7349  -  1.1414 

and  Dressing 

Independence  in  Traveling 

.949 

.8226-  1.0947 

Better  Stamina 

(Walking,  lifting,  climbing  stairs) 

.969 

.8498  -  1.1042 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  (MDS). 

'Differences  between  treatment  groups  are  significant  at  the  .05  level. 

'Pittsburgh  data  excluded  from  analyses. 

bSan  Diego  beneficiaries  excluded  due  to  noncomparable  coding. 
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The  intervention  did  not  appear  to  have  a  significant  effect  on  the  bed  days 
outcomes.  Having  a  hospital  admission  prior  to  the  baseline  interview  was  positively 
associated  with  having  any  bed  days  during  the  follow-up  period  and  individuals  with  a 
longer  follow-up  period  were  more  likely  to  experience  bed  days.  Once  again,  the  strongest 
predictor  of  bed  days  during  follow-up  was  having  bed  days  at  baseline. 

Although  the  intervention  did  not  have  an  effect  on  whether  a  beneficiary  was  likely 
to  experience  any  falls,  older,  more  educated  women  and  those  living  alone  were  more  likely 
to  fall,  controlling  for  other  factors.  The  strongest  predictor  of  not  falling  during  follow-up 
was  not  falling  at  baseline. 

The  function  outcomes  which  were  examined  in  these  analyses  include  independence 
in  bathing  and  dressing,  independence  in  travel,  and  stamina.  As  shown  in  Exhibit  6-5,  the 
intervention  did  not  have  a  significant  effect  on  any  of  these  outcomes.  However,  being 
older,  female  or  having  a  prior  hospital  stay  was  associated  with  being  dependent  or  having 
less  stamina,  controlling  for  other  factors. 

The  effect  of  the  intervention  on  the  QWB  scores  for  mobility,  physical  activity  and 
social  activity  scales  individually  was  also  examined,  although  the  data  are  not  presented  in 
this  chapter.  Being  white  and  having  a  better  QWB  score  at  baseline  were  associated  with 
better  QWB  scores  at  follow-up  across  the  three  scales.  Being  older,  female  or  having  a 
prior  admission  were  associated  with  lower  QWB  scores  at  follow-up  for  the  mobility  and 
physical  activity  scales,  but  the  female  effect  was  not  observed  for  the  social  activity  scale. 

In  conclusion,  after  controlling  for  a  wide  range  of  beneficiary  and  project 
characteristics,  the  intervention  had  a  positive  effect  on  self-reported  health  but  no  observed 
effect  on  the  other  health  and  function  outcomes  that  were  examined. 
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7.0  EFFECTS    OF    THE    DEMONSTRATION    ON    BENEFICIARY  HEALTH 
BEHAVIORS 

7.1  Overview 

One  goal  of  the  COBRA  prevention  demonstrations  was  to  determine  whether  such 
services  would  lead  to  improved  health  practices  and  behaviors  for  Medicare  beneficiaries. 
This  chapter  presents  the  results  of  descriptive  analyses  and  testing  of  the  hypotheses  which 
were  posited  a  priori  in  the  crosscutting  evaluation  design  and  are  enumerated  below. 

Hypothesis:  The  intervention  will  have  no  short-term  effect  on  participants'  self- 
reported  health  behaviors. 

Alternative  hypothesis:  The  intervention  will  have  no  short-term  effect  on 
participants'  self-reported  health  behaviors  but  will  improve  health  behaviors  in  the 
long  run. 

This  chapter  is  organized  as  follows.  Section  7.2  describes  the  data  sources  and 
limitations,  dependent  variables  and  analytic  approach  used  for  these  outcome  analyses. 
Section  7.3  describes  the  sample  of  beneficiaries  by  experimental  group  and  discusses 
differences  in  this  sample  across  demonstration  projects.  Section  7.4  presents  results  of 
bivariate  analyses  of  outcome  data.  This  chapter  concludes  with  a  presentation  of  the 
results  of  multivariate  analyses  and  hypotheses-testing  in  Section  7.5. 

7.2  Data  Issues 

This  section  describes  the  data  sources  which  were  used  for  the  outcome  analyses  and 
the  limitations  of  these  data.  Dependent  variables  and  relevant  measurement  problems  are 
then  described  and  the  analytic  approach  is  presented. 

7.2.1   Data  Sources  and  Limitations 

The  data  used  in  the  health  practice  and  behavior  outcome  analyses  were  collected 
by  the  five  demonstration  projects  at  baseline  (pre-intervention)  and  follow-up 
(post-intervention)  through  personal  interviews,  telephone  interviews  and/or  written 
questionnaires  with  Medicare  beneficiaries  who  agreed  to  participate  in  this  study.  These 
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data  were  processed  by  the  projects  and  were  submitted  to  the  crosscutting  evaluation 
contractor. 

Although  the  contractor  had  specified  the  MDS  for  this  crosscutting  evaluation 
before  the  demonstration  was  implemented,  the  files  submitted  by  the  projects  did  not 
contain  all  specified  data  elements.  Therefore,  the  contractor  attempted  to  construct  a 
reduced  version  of  the  MDS  based  upon  the  availability  of  the  projects'  data.  Because  the 
outcome  analyses  required  both  baseline  and  follow-up  measures  of  the  dependent  variables, 
those  projects/beneficiaries  in  which  either  measures  were  missing  are  excluded  from 
analyses.  Since  the  projects  asked  different  questions  to  collect  certain  MDS  items,  these 
measures  were  not  always  comparable  across  projects.  As  is  described  in  Section  7.2.2.,  the 
health  behavior  outcomes  were  recoded  so  that  they  retained  their  meaning  but  could  be 
compared  across  projects. 

7.2.2   Definition/Construction  of  Dependent  Variables 

Changes  in  health  practices  and  behaviors  were  analyzed  by  comparing  experimentals' 
and  controls'  health  behaviors,  including  smoking  behavior,  alcohol  consumption,  frequency 
of  exercise/physical  activity,  use  of  seatbelts,  having  a  mammogram  within  the  past  1-2  years, 
and  seeking  information  about  health.  Although  there  is  disagreement  among  experts 
regarding  the  benefits  of  some  health  behaviors  in  the  elderly  population,  there  is  general 
agreement  that  avoidance  of  smoking,  abstinence  or  moderate  drinking  and  moderate 
exercise  are  good  health  practices.  The  benefits  of  seatbelt  use  and  mammograms  are  also 
undisputed.  The  process  of  acquiring  information,  either  for  disease  prevention  or 
treatment  of  symptoms,  can  lead  to  the  adoption  of  new  health  practices  (Rakowski,  1992). 

The  smoking  measure  used  in  this  analysis  was  a  dichotomous  variable  (smoke/do 
not  smoke).  Alcohol  use  was  measured  as  the  total  number  of  alcoholic  drinks  consumed 
per  week,  based  upon  the  MDS  measures.  A  change  score,  reflecting  only  a  decrease, 
increase,  or  no  change,  was  computed  between  baseline  and  follow-up.  Seatbelt  use  was 
originally  measured  as  two  items-driver  use  and  passenger  use-but  was  combined  to  a 
single  item-driver  or  passenger~to  accommodate  differences  across  projects  given  the  way 
the  question  was  asked.  The  measure  developed  to  capture  mammogram  utilization 
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required  the  recoding  of  two  responses  to  the  question  regarding  the  number  of  years  since 
last  mammogram  (less  than  1  year,  1-2  years)  to  a  single  response  (within  the  past 
1-2  years).    This  recoding  allowed  all  project  data  to  be  included  in  the  analysis  of 
mammogram  use. 

The  measure  that  presented  the  greatest  challenge  was  exercise.  Four  projects  asked 
questions  about  exercise  four  different  ways.  Because  exercise  was  considered  an  important 
behavior  outcome  that  should  not  be  excluded  from  these  analyses,  a  measure  was 
constructed  that  could  be  compared  across  projects.  Computing  the  frequency  of  exercise 
for  an  MDS  measure  was  not  difficult-the  final  response  options  were  "never,"  "1-3  times 
per  week,"  and  "3  or  more  times  per  week."  The  difficulty  lay  in  trying  to  capture  a  similar 
content  and  intensity  of  exercise  across  projects.  Johns  Hopkins  asked  "How  often  in  a 
week  do  you  perform  physical  activities  such  as  walking  briskly,  gardening  or  heavy 
housework?"  UCLA  asked  "Do  you  follow  a  regular  routine  of  physical  exercise?"  If  "yes," 
"How  often  do  you  participate  in  active  sports  that  may  cause  you  to  work  up  a  sweat  or 
become  winded?"  A  "no"  response  to  the  initial  question  was  coded  as  "never  exercises." 
San  Diego  asked  about  the  frequency  of  exercises  to  improve  strength,  flexibility  and 
endurance.  Beneficiaries  in  Washington  recorded  the  number  of  times  during  the  past 
2  weeks  in  which  they  participated  from  a  list  of  approximately  25  activities.  The 
crosscutting  evaluator  selected  18  of  the  25  activities  in  Washington  that  required  some 
exertion  (required  one  to  work  up  a  sweat  or  become  winded)  and  that  were  contained  in 
both  baseline  and  follow-up  questionnaires  of  each  project,  summed  the  items  and  divided 
the  result  by  two  to  arrive  at  a  weekly  exercise  measure.  It  is  clear  that,  even  after  these 
efforts,  the  measures  are  not  entirely  comparable  across  projects,  which  was  confirmed 
through  regression  analysis,  controlling  for  age,  sex,  prior  hospital  admission  and  education. 
A  very  strong  project  effect  was  observed.  Therefore,  measurement  differences  across 
projects  were  controlled  for  in  multivariate  models  by  introducing  a  project  by  baseline 
outcome  interaction  term. 

The  three  information-seeking  items  -  from  reading  articles  about  health,  from 
television/radio,  and  from  friends  --  were  summed  to  a  scale  with  a  range  of  three  (least 
information-seeking)  to  nine  (most  information-seeking).  Mean  scores  for  information- 
seeking  were  computed  and  compared  by  experimental  group. 
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7.2  J   Analytic  Approach 

Analyses  followed  the  intent  to  treat  model  (Peto  and  colleagues,  1976  op.  cit)  and 
included  all  subjects  allocated  to  the  experimental  group,  whether  or  not  they  actually 
received  the  intervention.  Subjects  with  missing  baseline  or  follow-up  measures  were 
dropped  from  the  analyses. 

Bivariate  analyses  compared  the  experimental  and  control  groups  across  various 
health  behavior  measures.  Baseline  measures  are  presented  and  change  scores  computed 
from  baseline  to  follow  up.  Pearson's  chi-square  statistic  was  used  to  test  whether  outcomes 
are  associated  with  experimental  status. 

Multivariate  analyses  tested  the  effect  of  the  intervention  on  the  dependent  variables 
of  interest  while  controlling  for  sociodemographic  and  other  factors.  Multivariate  models 
were  developed  to  test  hypotheses  regarding  differences  between  experimentals  and  controls 
on  a  given  follow-up  dependent  variable.  Logistic  regression  was  used  for  binary  dependent 
variables  (smoking,  never  exercise,  exercise  3+  times  per  week,  always  use  seatbelts,  never 
had  a  mammogram,  had  a  mammogram  within  the  past  year).  Information-seeking  scores 
were  modeled  using  linear  least  squares  regression.  Ordinal  logistic  regression  was  used  for 
the  ordered  outcome  variables  (e.g.,  change  in  drinking  behavior). 

In  addition  to  an  experimental  group  indicator,  each  model  includes  categorical 
variables  for  each  project  and  covariates  to  control  for  sociodemographic  factors  (age,  sex, 
race,  education,  income,  lives  alone,  completely  retired),  the  number  of  days  between 
baseline  and  follow-up  interviews,  whether  there  were  any  hospital  admissions  during  the 
year  prior  to  the  baseline  interview,  and  the  baseline  measure  of  the  variable.  By 
controlling  for  the  project  and  the  baseline  measure  of  each  outcome,  and  including  a 
project-by-baseline-measure  interaction  term,  the  effect  of  measurement  problems  due  to 
noncomparable  questions  or  referent  time  periods  across  projects  will  be  reduced. 

7  J      Sample  Description 

The  sample  of  beneficiaries  used  in  the  health  behavior  outcome  analyses  is  the  same 
used  in  the  health  and  functional  outcome  analyses  (see  sample  in  Section  6.3  and  Exhibit 
6.1).     Comparable  groups  across  the  four  projects,  relative  to  socio-demographic 
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characteristics,  were  included  in  this  sample,  with  the  exception  that  experimental 
beneficiaries  were  slightly  more  likely  (p<.05)  to  be  white  than  control  beneficiaries.  Johns 
Hopkins  accounted  for  36.5  percent  of  the  sample  for  these  analyses,  followed  by 
Washington,  accounting  for  28.3  percent  Nineteen  percent  of  the  sample  members  were 
from  the  UCLA  project  and  16.2  percent  were  from  San  Diego. 

7.4      Bivariate  Analyses  of  Outcomes 

The  distribution  of  health  behavior  outcome  measures  described  in  Section  7.2  is 
presented  in  Exhibit  7- 1  for  experimental  and  control  beneficiaries  at  baseline  and  follow- 
up.  Smokers  represented  slightly  over  10  percent  of  the  entire  sample.  However,  no 
differences  were  observed  in  smoking  behavior  between  experimentals  and  controls  at 
baseline.  Although  there  was  no  difference  between  the  two  groups  in  the  proportion  of 
individuals  who  reported  never  exercising  at  baseline,  the  experimental  group  was  slightly 
less  likely  to  report  this  behavior  at  follow-up  (p<-l).  Conversely,  experimentals  were  more 
likely  to  report  exercising  three  or  more  times  per  week  at  follow  up  than  controls  (p<.05), 
even  though  the  two  groups  were  comparable  at  baseline.  There  were  no  differences 
between  the  two  groups  in  regular  seatbelt  use,  but  there  was  a  slight  overall  increase 
among  all  enrollees  in  this  behavior  from  baseline  to  follow-up.  The  same  held  true  for  use 
of  mammograms-although  there  did  not  appear  to  be  any  difference  between 
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EXHIBIT  7-1 


COBRA  Medicare  Prevention  Demonstration  Evaluation 

Comparison  of  Health  Behavior  Outcome  Measures  of 
Experimental  and  Control  Groups* 


Health  Behavior 
Measure 


Experimental 

(11=4255) 


Control 

(n=4279) 


Total 

(n=8534) 


Percent  Who  Smokeb 

10.4 

20.0 

11.4 

17.6 

10.9 

18.7 

Percent  Who  Never 
Exercise 

20.4 

21.4 

20.0 

23.1 

20.2 

22.3* 

Percent  Who  Exercise 
3+  Times  per  Week 

60.2 

60.8 

61.0 

58.1 

60.6 

59.4* 

Percent  Who  Always 
Use  Seatbelts 

85.0 

87.7 

85.8 

88.1 

85.4 

87.9 

Percent  of  Women 
Who  Never  Had  a 
Mammogram 

29.1 

20.1 

27.9 

21.7 

28.5 

20.9 

Percent  of  Women 
Who  Had  a 
Mammogram  within 
the  Past  1-2  Years 

54.8 

65.9 

56.9 

63.8 

55.8 

64.8 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set. 


'  Pittsburgh  beneficiaries  are  not  included. 

b  Follow-up  measure  refers  to  percentage  of  smokers  at  baseline  who  had  quit  at  follow-up. 

+  Differences  between  treatment  groups  are  significant  at  the  0.10  leveL 

*  Differences  between  treatment  groups  are  significant  at  the  .05  level 
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the  two  groups,  there  was  an  overall  increase  in  the  proportion  of  women  having 
mammograms. 

Alcohol  consumption  did  not  differ  between  experimental  and  control  beneficiaries 
at  baseline,  as  shown  in  Exhibit  7-2.  However,  when  examining  the  change  in  alcohol 
consumption  from  baseline  to  follow  up,  experimental  beneficiaries  were  more  likely  to  have 
experienced  a  decrease  in  alcohol  consumption  and  less  likely  to  have  experienced  an 
increase  in  alcohol  consumption  than  were  controls. 

The  final  behavior  examined  was  information-seeking.  Scores  based  on  sums  across 
three  measures  of  information-seeking  were  computed  and  compared  by  experimental  group 
using  analysis  of  variance.  There  were  no  differences  between  the  two  groups  at  baseline 
or  follow-up.  For  example,  baseline  experimentals  averaged  6.68  (standard  deviation  =  1.60) 
and  controls  averaged  6.64  (standard  deviation  =1.66)  out  of  a  perfect  score  of  9.0.  No 
change  was  observed  at  followup. 

7.5      Multivariate  Analyses  of  Outcomes 

This  section  presents  adjusted  estimates  of  the  differences  between  experimentals  and 
controls  on  a  given  follow-up  dependent  variable.  Logistic  regression  was  used  for  binary 
dependent  variables  (smokes,  never  exercises,  exercises  three  or  more  times  per  week, 
always  uses  seatbelt,  had  a  mammogram  within  the  past  1-2  years).  Information-seeking 
scores  were  modeled  using  linear  least  squares  regression.  Ordinal  logistic  regression  is 
used  to  model  the  change  in  alcohol  consumption. 

Because  of  the  significant  differences  in  the  composition  of  the  study  sample  across 
projects,  models  controlled  for  those  sociodemographic  characteristics  that  differed  by 
project  or  that  could  influence  the  outcome  measures.  Age  was  included  in  the  models  as 
a  continuous  variable.  Categorical  variables  (0=no,  l=yes)  included:  member  of 
experimental  group,  female,  white  race,  college-educated,  having  a  household  income  of  less 
than  $5,000,  having  a  household  income  of  greater  than  $35,000,  living  alone,  and 
completely  retired.  In  order  to  control  for  the  existence  of  prior  health  problems,  the 
models  included  a  categorical  variable  indicating  whether  the  beneficiary  had  any  hospital 
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EXHIBIT  7-2 


COBRA  Medicare  Prevention  Demonstration  Evaluation 

Comparison  of  Drinking  Behavior  Outcome  Measures  of 
Experimental  and  Control  Groups* 


Drinking  Behavior 

Experimental 
<n*1755) 

Control 
(n«1758) 

Total 
<n«3513) 

Number  of  Alcoholic 
Beverages  Consumed  per 
Week 

o 

37.8 

37.7 

37.8 

1  •  4 

37.8 

37.4 

37.6 

5  -  8 

12.5 

14.4 

13.5 

9  •  14 

7.6 

6.8 

7.2 

15  + 

4.2 

3.6 

3.9 

Change  in  Alcohol 
Consumption  from 
Baseline  to  Follow -Up* 

Decreased 

25.3 

22.2 

23.7 

No  Change 

62.8 

63.6 

63.2 

Increased 

11.9 

14.2 

13.1 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set. 
•Difference*  between  treatment  grouse  ere  significant  at  the  .05  level. 
■Data  represent  UCLA  and  Washington  only. 
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admissions  during  the  year  prior  to  the  baseline  interview.  Because  not  all  projects 
conducted  their  follow-up  interviews  at  the  same  time  relative  to  the  baseline  interview,  a 
continuous  measure  of  the  number  of  days  between  baseline  and  foUow-up  was  also 
included.  Finally,  to  control  for  the  project  differences  and  outcome  measurement 
differences  that  were  observed  and  described  in  Section  7.2,  the  model  included  project 
categorical  variables,  the  baseline  measure  of  the  outcome,  and  project-by-baseline-outcome- 
measure  interaction  terms. 

The  results  of  these  analyses  are  summarized  in  Exhibit  7-3.  Adjusted  estimates  of 
the  experimental  effect  (measured  by  the  log  of  the  ratio  of  two  probabilities,  or  the  "odds" 
of  a  particular  outcome)  and  95  percent  confidence  intervals  are  presented,  while  controlling 
for  all  variables  in  the  model.  The  positive  effects  of  experimental  status  were  observed 
for  measures  of  exercise,  regular  seatbelt  use,  decreasing  one's  consumption  of  alcohol,  and 
having  a  mammogram  within  the  past  1-2  years.  As  shown  in  Exhibit  7-3,  members  of  the 
intervention  group  were  approximately  15  percent  less  likely  to  report  never  exercising  and 
nearly  20  percent  more  likely  to  report  exercising  three  or  more  times  per  week  than 
members  of  the  control  group.  Similarly,  regular  seatbelt  use  was  about  15  percent  more 
likely  and  mammograms  about  23  percent  more  likely  among  members  of  the  experimental 
group.  Smoking  behavior  did  not  differentially  change  between  the  two  groups.  Because 
the  change  in  alcohol  consumption  outcome  is  ordinal,  ranging  from  a  decrease  in  alcohol 
consumption  (1)  to  an  increase  (3),  this  effect  can  be  represented  as  a  16.8  percent  shift  in 
the  overall  distribution  of  experimental,  toward  a  decline  and  away  from  an  increase  in 
alcohol  consumption  relative  to  controls.  Smoking  behavior  did  not  differentially  change 
between  the  two  groups. 

Other  factors  also  had  significant  effects  on  the  outcome  measures.  Smokers  were 
younger  and  more  likely  to  have  had  a  hospital  admission  during  the  year  prior  to  the 
baseline  interview.  The  strongest  predictor  of  not  smoking  at  follow-up  was  not  smoking 
at  baseline.  Beneficiaries  who  always  wore  seatbelts  were  over  50  percent  more  likely  to 
be  white.  The  strongest  predictor  of  not  wearing  a  seatbelt  at  follow-up  was  not  wearing 
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EXHIBIT  7-3 


COBRA  Medicare  Prevention  Demonstration  Evaluation 

Adjusted  Odds  Ratios  and  95%  Confidence  Intervals  of  the  Effect  of  Experimental 
Status  on  Health  Behavior  Outcomes  at  Follow-Up1 


Health  Outcomes  at  Follow-Up 

Adjusted  Odds 
Ratio 

95%  Confidence 
Interval 

Smokes 

.910 

.6780  -  1.2211 

Never  Exercises 

.856  * 

.7399  -  .9904 

Exercises  3+  Times  per  Week 

1.193  ** 

1.0634  -  1.3391 

Always  Uses  Seatbelt 

1.156  + 

.9721  -  1.3752 

Decline  in  Alcohol  Consumption 

1.168  * 

1.000  -  1.3641 

Had  a  Mammogram  within  the 
Past  1-2  Years 

1.233  * 

1.0497  -  1.4483 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set. 

'    Pittsburgh  data  excluded  from  analyses. 

+  Significant  at  the  .10  level. 
*  Significant  at  the  .05  level. 
**  Significant  at  the  .01  level. 
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one  at  baseline.  Older,  white  women  and  those  who  lived  alone  were  less  likely  to  have  a 
mammogram  within  the  past  1-2  years.  Beneficiaries  in  the  lowest  (<  $5,000)  and  highest 
(>  $35,000)  income  categories  were  more  likely  to  have  a  mammogram  within  the  past 
1-2  years.  Consistent  with  other  outcomes,  the  strongest  predictor  of  not  having  a 
mammogram  within  the  past  1-2  years  at  follow-up  was  not  having  one  at  baseline.  Older 
beneficiaries  and  those  who  had  a  hospital  admission  prior  to  the  baseline  interview  were 
more  likely  to  report  never  exercising  at  follow  up.  Individuals  who  were  the  least  likely 
to  report  not  exercising  at  follow  up  had  more  education  and  higher  incomes.  Frequent 
exercisers  (three  or  more  times  per  week)  were  more  likely  to  be  white  and  college- 
educated,  while  older  women  were  less  likely  to  report  this  behavior.  These  models 
included  a  project-by-baseline-outcome-measure  interaction  term  to  control  for 
measurement  differences  across  projects.  The  interaction  term  for  exercising  three  or  more 
times  was  significant  for  two  projects.  No  measurement  effect  was  observed  for  the  never 
exercise  measure. 

The  effect  of  the  intervention  on  information-seeking  was  also  examined,  although 
the  data  are  not  presented  here.  Alcohol  consumption  at  baseline  was  the  only  variable  that 
was  associated  with  alcohol  consumption  at  follow  up.  Information-seeking  at  baseline  and 
being  female  were  associated  with  information-seeking  at  follow  up. 

In  conclusion,  after  controlling  for  beneficiary  characteristics,  the  intervention 
appears  to  have  had  a  positive  effect  on  exercising,  seatbelt  use,  alcohol  consumption,  and 
the  likelihood  of  having  a  mammogram  within  the  past  1-2  years.  No  impact  was  observed 
for  smoking  or  seeking  out  information  about  health. 
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8.0     SUMMARY  AND  CONCLUSIONS 

The  COBRA  Medicare  Prevention  Demonstration  projects  substantially  met 
their  recruitment  targets,  and  an  average  of  80  percent  of  enrollees  who  were 
assigned  to  experimental  status  actually  used  some  demonstration  preventive  services 
during  the  first  year. 

Experimental  status  was  not  associated  with  significant  reductions  in  Medicare- 
reimbursed  acute  services  utilization.  However,  there  was  clear  evidence  that  those 
enrollees  who  used  preventive  services  were  different  from  those  who  did  not,  both 
in  predisposing  characteristics  (demographic,  socioeconomic)  and  in  actual  use  of 
acute  services.  Within  the  randomly  assigned  study  populations,  self-selection  into 
users  and  non-users  occurred  during  the  initial  years  of  the  demonstration. 

Experimental  status  was  associated  with  some  unexpected  short-term 
improvements  in  certain  measures  of  health  status  and  health  behavior  relative  to 
controls.  Although  not  all  measures  confirmed  these  positive  findings,  the  evidence 
for  true  demonstration  effects  is  compelling.  In  particular,  after  controlling  for 
beneficiary  characteristics,  the  intervention  appears  to  have  had  a  positive  effect  on 
exercising,  seatbelt  use,  alcohol  consumption,  and  the  likelihood  of  having  a 
mammogram  within  the  past  1-2  years. 

During  the  final  2  years  of  the  demonstration  (Years  5  and  6),  the  projects  will 
collect  additional  data  on  participants  and  complete  their  own  evaluations.  Plans  for 
additional  data  collection  vary.  San  Diego  expects  to  conduct  two  additional  follow- 
up  surveys  of  experimentals  and  controls.  Johns  Hopkins  plans  one  more  follow-up 
survey.  Most  of  the  projects  have  sub-studies  in  progress,  and  some  have  published 
findings.  HCFA  has  awarded  a  new  contract  for  the  cross  cutting  evaluation.  During 
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Year  6  of  the  demonstration,  the  individual  projects  will  conduct  their  evaluations, 
the  crosscutting  evaluation  will  be  completed,  and  a  final  report  on  the  cost- 
effectiveness  of  a  preventive  services  benefit  package  will  be  submitted  to  Congress 
by  April  1,  1995. 
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Appendix  A 
Characteristics  of  EnroIIees  By  Site 


COBRA  MEDICARE  PREVENTION  DEMONSTRATION  EVALUATION 
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COBRA  Medicare  Prevention  Demonstration  Evaluation 
Percentage  Of  Medicare  Beneficiaries  Participating  In  The  Demonstration  At  Baseline 
And  Follow-up  By  Selected  Socio-Demographic  Characteristics 

UCLA 


Baseline  Follow-up 


ilk  perunenia  i 
(n  =  7915) 

Control 

(n  =  6434) 

Vx  nerimental 
(n  =  5821) 

Control 
(n  =  5156) 

Female 

jo.y/0 

SI  1  % 

59.0% 

56.6% 

Over  80  Years 

10  5% 

11.0% 

9.8% 

wniic 

87.2% 

87.9% 

87.5% 

88.5% 

Married 

60.4% 

60.6% 

59.9% 

60.6% 

Alone 

34.7% 

34.0% 

36.6% 

34.4% 

Lives  in  Special  Residence  for 

2.2% 

3.0% 

2.2% 

2.0% 

Elderly 

Some  College  Education 

57.0% 

55.7% 

57.7% 

56.2% 

Retired 

63.5% 

65.1% 

64.2% 

67.5% 

Highest  Income 

22.3% 

23.7% 

24.6% 

23.1% 

Source:         COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  (MDS). 


Note:  Percentages  are  based  on  observations  without  missing  values. 


COBRA  Medicare  Prevention  Demonstration  Evaluation 
Percentage  Of  Medicare  Beneficiaries  Participating  In  The  Demonstration  At  Baseline 
And  Follow-up  By  Selected  Socio-Demographic  Characteristics 

University  of  Washington 


Baseline  Follow-up 


Experimental 

Control 

Experimental 

Control 

111  —  JljU/ 

Female 

£.n  a  at 

60.4% 

£/\  |  at 

bl.  1  % 

sr\  *\  at 

a\  not 

61 .9% 

Over  80  Years 

i  n  c  at 

in  14 

III.  J  7b 

in  iat 
IU.  J  7b 

V.o  % 

White 

an  not 

Of.  1  at 

y  1  .yjyo 

q/:  -lie 

70.  J  AO 

Married 

65.4% 

63.7% 

63.3% 

62.9% 

Alone 

29.1% 

30.4% 

30.3% 

30.5% 

Lives  in  Special  Residence  for 
Elderly 

3.4% 

3.9% 

3.3% 

3.6% 

Some  College  Education 

55.3% 

54.4% 

55.8% 

54.8% 

Retired 

69.2% 

69.7% 

69.9% 

71.1% 

Highest  Income 

6.0% 

6.2% 

5.4% 

8.1%* 

Source:         COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  (MDS). 


*  Significantly  different  between  experimental  and  control  participants  at  the  .05  level. 
Note:  Percentages  are  based  on  observations  without  missing  values. 


COBRA  Medicare  Prevention  Demonstration  Evaluation 
Percentage  Of  Medicare  Beneficiaries  Participating  In  The  Demonstration  At  Baseline 
And  Follow-up  By  Selected  Socio-Demographic  Characteristics 

Johns  Hopkins  University 


Baseline  Follow-up 


Experimental 
(n  =  7915) 

Control 
(n  =  6434) 

Experimental 
(n  =  5821) 

Control 
(n  =  5156) 

Female 

62  9% 

63  3% 

62  8% 

65  2% 

Hiiar  fin  Voire 

i /ver  ou  i  ears 

1  U.J 

17  1 

13  2 

12  1 

W  IUIC 

87.6 

83.8%** 

87.4 

83.4** 

Married 

46.0% 

45.4% 

44.8% 

45.4% 

Alone 

33.4% 

33.1% 

34.8% 

33.4% 

Lives  in  Special  Residence  for 
Elderly 

0.9% 

2.0%** 

1.8% 

2.9%* 

Some  College  Education 

11.5% 

10.1% 

13.0% 

11.5% 

Retired 

69.7% 

68.2%** 

73.6% 

73.3% 

Highest  Income 

0.2% 

0.2% 

1.8% 

1.8% 

Source:         COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  (MDS). 


*  Significantly  different  between  experimental  and  control  participants  at  the  .05  level. 
**      Significantly  different  between  experimental  and  control  participants  at  the  .01  level. 

Note:  Percentages  are  based  on  observations  without  missing  values. 


COBRA  Medicare  Prevention  Demonstration  Evaluation 
Percentage  Of  Medicare  Beneficiaries  Participating  In  The  Demonstration  At  Baseline 
And  Follow-up  By  Selected  Socio-Demographic  Characteristics 


University  of  Pittsburgh 


Baseline  Follow-up 


Experimental 
(n  =  7915) 

Control 
(n  =  6434) 

Experimental 
(n  =  5821) 

Control 
(n  =  5156) 

Female 

56.8% 

56.7% 

62.8% 

60.0% 

Over  80  Years 

0.1% 

0.2% 

0.1% 

0.2% 

White 

100% 

100% 

100% 

100% 

Married 

68.2% 

69.7% 

63.3% 

65.0% 

Alone 

25.6% 

26.6% 

29.2% 

27.8% 

Lives  in  Special  Residence  for 
Elderly 

5.2% 

6.2% 

5.4% 

7.3%  + 

Some  College  Education 

16.5% 

16.2% 

14.7% 

15.6% 

Retired 

83.6% 

82.4% 

83.1% 

80.7% 

Highest  Income 

1.5% 

1.0% 

1.4% 

0.9% 

Source:         COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  (MDS). 


+  Significantly  different  between  experimental  and  control  participants  at  the  .  10  level. 
Note:  Percentages  are  based  on  observations  without  missing  values. 


COBRA  Medicare  Prevention  Demonstration  Evaluation 
Percentage  Of  Medicare  Beneficiaries  Participating  In  The  Demonstration  At  Baseline 
And  Follow-up  By  Selected  Socio-Demographic  Characteristics 


San  Diego 


Baseline  Follow-up 


Experimental 

in  —  not  ci 
in  —  /via) 

Control 

Experimental 

Control 

Female 

56.0% 

c  a  n  of 

54.9% 

co  n  of 

58.9% 

57. 1  % 

Over  80  Years 

f    m  erf 

6.5% 

7.5% 

A   1  Of 

4.3% 

*C    tC  Of  * 

6.6%* 

White 

95.4% 

Ol  1  or  * 
9/.  1  % 

ok  oat 

yj.y  to 

OH  <  OL 
"O.J  % 

Married 

60.7% 

62.3% 

61.4% 

63.4% 

Alone 

33.8% 

30.4% 

36.8 

32.8% 

Lives  in  Special  Residence  for 
Elderly 

3.9% 

4.1% 

3.2% 

4.6% 

Some  College  Education 

59.8% 

59.5% 

63.6% 

61.5% 

Retired 

68.6% 

72.1% 

70.8% 

72.4% 

Highest  Income 

9.0% 

8.1% 

10.6 

8.0% 

Source:         COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  (MDS). 


*  Significantly  different  between  experimental  and  control  participants  at  the  .05  level. 
Note:  Percentages  are  based  on  observations  without  missing  values. 
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Characteristics  of  Enrollees 
By  Receipt  and  Non-Receipt  of  Intervention  Services 

By  She 


COBRA  MEDICARE  PREVENTION  DEMONSTRATION  EVALUATION 

CHARACTERISTICS  OF  EXPERIMENT ALS  BY  RECEIPT  AND  NON-RECEIPT 
OF  INTERVENTION  SERVICES 

JOHNS  HOPKINS 


DID  NOT  RECEIVE 
SERVICES 


RECEIVED  SERVICES 


SOCIO-DEMOGRAPHIC 
Female 
Over  80  Yrs 
White 
Married 
Live*  Alone 

Lives  in  Special  Residence  for  Elderly 
Some  College  Education 
Completely  Retired 
Highest  Income 
FUNTIONAL  STATUS 

Dependent  in  1  or  More  ADLs 
Dependent  in  1  or  More  I  ADLs 
Incontinent 

1  or  More  Health  Conditions 
Vision  or  Hearing  Problem 
1  or  More  Disability  Days 
1  or  More  Bed  Days 
RISK  FACTORS 
Drinker 
Smoker 

In  Good  Health 


66.9% 
19.4% 
87.0% 
40.9% 
34.9% 

I.  2% 
10.7% 
69.8% 

0.2% 

II.  6% 
5.3% 


36.8% 
27.1% 
3.5% 


15.8% 
46.8% 


60.2%» 
14.2% 
88.1%" 
49.5%" 
32.3  %• 

0.6% 
12.1%" 
70.2%" 

0.2% 

8.0%" 
4.9% 


37.1%« 
23.4%  + 
2.0%« 


15.4% 
49.3% 


Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set 

+  Significant  at  the  .10  level 
«  Significant  at  the  .05  level 
"     Significant  at  the  .01  level 


Note:  Percentages  are  baaed  on  observations  without  missing  values. 
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COBRA  MEDICARE  PREVENTION  DEMONSTRATION  EVALUATION 

CHARACTERISTICS  OF  EXPERIMENT ALS  BY  RECEIPT  AND  NON-RECEIPT 
OF  INTERVENTION  SERVICES 

UNIVERSITY  OF  PITTSBURGH 

DID  NOT  RECEIVE 

  SERVICES  RECEIVED  SERVICES 

SOCIO-DEMOGRAPHIC 
Female 
Over  80  Yrs 
White 
Married 
Lives  Alone 

Live*  in  Special  Residence  for  Elderly 
Some  College  Education 
Completely  Retired 
Highest  Income 
FUNCTIONAL  STATUS 

Dependent  in  1  or  More  AD  Li 
Dependent  in  1  or  More  lADLs 
Incontinent 

1  or  More  Health  Conditions 
Vision  or  Hearing  Problem 
1  or  More  Disability  Days 
1  or  More  Bed  Days 
RISK  FACTORS 
Drinker 
Smoker 

In  Good  Health  

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set 

+  Significant  at  the  .10  level 

•  Significant  at  the  .05  level 

**  Significant  at  the  .01  level 

Note:  Percentages  are  based  on  observations  without  missing  values. 
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55.2* 
0.4% 
100.0% 
67.7% 
24.4% 
6.1% 
11.1% 
83.9% 
0.7% 

4.7% 
11.8% 
25.0% 
78.1% 
47.0% 
22.0% 
18.0% 

42.2% 
17.9% 


57.0% 

0.2% 
100.0% 
68.3% 
25.7% 

5.1% 
17.1%" 
83.5% 

0.2% 

2.6%« 
7.5%* 

29.7%  + 

78.0% 

41.8% 

27.3%* 

15.7% 

49.1  %• 
11-7%** 


COBRA  MEDICARE  PREVENTION  DEMONSTRATION  EVALUATION 

CHARACTERISTICS  OF  EXPERIMENT ALS  BY  RECEIPT  AND  NON-RECEIPT 
OF  INTERVENTION  SERVICES 

SAN  DIEGO 


DID  NOT  RECEIVE 
SERVICES 


RECEIVED  SERVICES 


SOCIO-DEMOGRAPHIC 
Female 

Over  80  Yrs 
White 
Married 
Lives  Alone 

Live*  in  Special  Residence  for  Elderly 
Some  College  Education 
Completely  Retired 
Highest  Income 
FUNCTIONAL  STATUS 

Dependent  in  1  or  More  ADLs 
Dependent  in  1  or  More  lADLs 
Incontinent 

1  or  More  Health  Conditions 
Vision  or  Hearing  Problem 
1  or  More  Disability  Days 
1  or  More  Bed  Days 
RISK  FACTORS 
Drinker 
Smoker 

In  Good  Health 


69.7* 
18.2* 
90.9* 
54.5* 
39.4* 
12.5* 
48.4* 
60.6* 
3.3* 


2S.8* 
59.4* 

12.1* 

0.0* 

67.2* 
18.8* 
24.2* 


55.5*  + 
6.0%  + 

95.6* 

61.0* 

33.6* 
3.5* 

60.2* 

68.9* 
9.2*  + 


18.4* 

72.7*  + 
21.7* 

8.1*" 

63.6* 
6.6*  + 
31.5* 


Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set 

+     Significant  at  the  .10  level 
Significant  at  the  .01  level 


Note:  Percentages  are  based  on  observations  without  missing  values. 
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COBRA  MEDICARE  PREVENTION  DEMONSTRATION  EVALUATION 

CHARACTERISTICS  OF  EXPERIMENT ALS  BY  RECEIPT  AND  NON-RECEIPT 
OF  INTERVENTION  SERVICES 

UCLA 


DID  NOT  RECEIVE 
SERVICES 


RECEIVED  SERVICES 


SOCIO-DEMOGRAPHIC 
Female 

Over  80  Yrs 
White 
Married 
Lives  Alone 

Live*  in  Special  Residence  for  Elderly 
Some  College  Education 
Completely  Retired 
Highest  Income 
FUNCTIONAL  STATUS 

Dependent  in  1  or  More  ADLs 
Dependent  in  1  or  More  IADLs 
Incontinent 

1  or  More  Health  Conditions 
Vision  or  Hearing  Problem 
1  or  More  Disability  Days 
1  or  More  Bed  Days 
RISK  FACTORS 
Drinker 
Smoker 

in  Good  Health 


61.7* 
13.9% 
88.0% 
57.5% 
34.7% 
4.0% 
52.0% 
61.5% 
23.8% 

11.0% 
13.6% 
38.5% 
77.7% 
73.3% 
55.2% 
53.5% 

76.6% 
8.8% 
33.9% 


57.8% 
10.4% 
87.0% 
61.6% 
34.8% 
2.2% 
59.0%  + 
64.2% 
21.7% 

5.4%" 
11.7% 
42.6% 
75.4% 
73.8% 
50.9% 
45.2%« 

77.3% 
6.6% 
39.6%  + 


Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data.  Set 

+    Significant  at  the  .10  level 
*     Significant  at  the  .05  level 
*•     Significant  at  the  .01  level 


Note:  Percentages  are  based  on  observations  without  missing  values. 
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COBRA  MEDICARE  PREVENTION  DEMONSTRATION  EVALUATION 

CHARACTERISTICS  OF  EXPERIMENT ALS  BY  RECEIPT  AND  NON-RECEIPT 
OF  INTERVENTION  SERVICES 

UNIVERSITY  OF  WASHINGTON 


DID  NOT  RECEIVE 
SERVICES 


RECEIVED  SERVICES 


SOCIO-DEMOGRAPHIC 
Female 

Over  80  Yrs 
White 
Married 
Living  Alone 

Live*  in  Special  Residence  for  Elderly 
Some  College  Education 
Completely  Retired 
Highest  Income 
FUNCTIONAL  STATUS 

Dependent  in  1  or  More  ADLs 
Dependent  in  1  or  More  IADLs 
Incontinent 

1  or  More  Health  Conditions 
Vision  or  Hearing  Problem 
1  or  More  Disability  Days 
1  or  More  Bed  Days 
RISK  FACTORS 
Drinker 
Smoker 

In  Good  Health 


61.6% 
17.7* 
95.4% 
61.4% 
31.9% 

8.1% 
50.5% 
66.2% 

9.0% 

8.2% 

5.1% 

5.3% 

73.2% 

37.9% 

2.1% 

56.6% 
8.2% 
34.3% 


60.2% 

9.2%" 
97.3% 
66.2% 
25.6% 

2.5%" 
56.1% 
69.8% 

5.5%  + 

4.3%* 
1.5%» 
4.8% 

67.9% 

39.5% 

1.8% 

63.8%  + 
8.4% 
45.2%" 


Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set 

+  Significant  at  the  .10  level 
•  Significant  at  the  .05  level 
••     Significant  at  the  .01  level 


Note:  Percentages  are  based  on  observations  without  missing  values. 
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PROBABILITY  OF  ALL  EXPERIMENTAL  PARTICIPANTS 
RECEIVING  INTERVENTION  SERVICES  WITHIN  THE  FIRST  YEAR 


(N  «  7561) 

Dependent  Variable  -  Receipt  of  Interrention  Services 


Independent  Variable 

VUC1 1 1VIC1J I 

jUOQIiu  CrrUr 

Intercept 

1.11 

.07»« 

Dummy: 

65-74  Yean 

0.35 

.07« 

Dummy: 

85+  Years 

-0.74 

.15" 

Dummy: 

Female 

-0.20 

.06»» 

Dummy: 

Some  College 

0.18 

.07*« 

Dummy: 

Smoker 

-0.32 

.09" 

Dummy: 

Bed  Days  Past  12  Months 

0.05 

.09 

Dummy: 

Risk  of  Hospital  Admission 

0.09 

.20 

Dummy:  Hospitalization  During 
Intake  Period 

-0.08 

.11 

Interaction  of  Hospitalization  During 
Intake  Period  and  LOS 

-0.02 

.01  + 

Dummy: 

HMO  Site 

0.90 

.08" 

Dummy:  Fee-for-Service  Site  and 
Beneficiary  Used  HMO  Provider 
After  Intake 

-0.33 

.20 

Source:  COBRA  Medicare  Prevention  Demonstration  Minimum  Data  Set  (MDS). 

+  Significant  at  the  .10  level 
**  Significant  at  the  .01  level 
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